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FOREWORD 



The U.S. Navy, f3cir>g rising costs associated with training, has 
attempted to iisprove cost-effectiveness -relative to^ training by devei- 
opir>g a self-paced Computer Managed Instruction ♦{C3<r) Systes, initial 
CMI training systems have been successful. Further sethods for devel- 
opir>g ev^n' -greater savirvgs have been exasined incl^xJing the ose of cog- 
rsunication satellites and other/ technologies as a delivery vehicle for 
OM at resiote operational sites. The project title was originally d^ 
rxved fro? the CoesBunication Satelli^ Concept and is called Computer 
Managed Instroction by Satellite (COKI^AT) . 

The project is sporjsored'by the Cybernetica Technology Office, 
Defense Advanced Research Projects Agency (ARPA) and the Research and 
Progras Developeent- Office, Chief of Kaval "Education and Training 
{CHSrj:) , CHCT's Training Analysis arvS 2valaaticxi Group (TAK3) serves a6 
the COHISAT Project Officer for CHET and as the Contracting Officer's 
Techn ical Representative (COTR) . • ^ , 

Planning Research Corporation Information Sciences Co^>dny, work- 
ing with ARPA and CNET/TAK, «8 responsible for the project backgro^ 
research 2md has responsibility for the design and preparation phases. 

Others involve! in the project incXc^ vjtrious cocsaands and agen- 
cies of the U.S. Ravy. OOHSAVTSLOOItl Is to' proyi^ ^e facility for 
the d»on.strationj RAVCOI«STA Stockton, CA is to provide the required 
students for the deaonstrationj the Saval *]^lecoaBiunicatlons Division^ 
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Chief of Raval Operational is^ to' approve the i»e the Havy telecoe- 
aanications systea for the de»onstration; the Management Instructional 
Information Systems Activity is to provi<^ computer support; the Chief 
of Raval Technical Training is to provide the CMI course and associated 
BaterialS; and the Havy Personnel Research amd Developtsent Center is to 
provide additional assistance in those areas where they have partici-'* 
pated in relevant research activities. 
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Chapter I 
IHTROODCTION 



A. Background 

This report addresses the second and a portion of the third p^iase 
of the project originally entitled Computer Manned Instruction by\. 
Satellite (COMISAT) • The project is sponsored by the Cybernetics- 
Technology Office, Defense Advanced Research Projects Agency (ARPA) and 
the Research and Progras Development Office, Chief of Haval Education 
and Training (CNET) . CKET's Training Analysis and Evaluation Groi^ 
{^A2G) serves as the COHISAT Project Officer for CKST and as the Con- 
tracting Officer's Technical Representative (COTR) . Planning Research 
Corporation Information Sciences Coiapany (pm/lSC) , working with ARPA 
and CHET/TAEG/ is responsible for the project background research and 
the design, development, lapleseotation, and evaluation of the 
desonstration. 

!• Project Genesis 

The acJceleration of military personnel costs has caused sill- 
tary personnel managers Vojp^arsue ways ols^imizing the retut^ on 'dol- 
lars expended and, where possible # to stalnlize or reduce costs/ One 
»ajt>r cau$e of accelerated co'sts is traifjing, a continuing and neces- 
sary requireaeri. 

r 

In an attempt *to address the training coet problem, the D*S* 
Havy" developed a self -paced, .doubter managed instruct icn {Oti) ' 
system. Tl^ systems approach to instructional development tras (»ed to 
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. ■ , ' ' f 

provide a set of priorltifed skills derived fro* task analysis. These 
skills were tr^l-ated into learning obje<?tlv«s at|>d then into learning 
■odules with aacoapanying self-paoed' learning materials and performance 
■easures.-^be teaming sodules wej^ then autgsatAd through CW. 

- , Thus f af ^ the achieve»enta of the" CW system, *rtiich provides 
' a means for guiding and counseling gstudents through a continau* of in- 
struction with oily minimal staff support, have been dramatic. The 
systes has significantly reduced course ti»e/ instxuctional and support 
personnea, anS stwJent attrition; it has* tignific«tntly increased stu- 
dent end-cf-coo^i!^ aclji'^v^ent levels; and it has been estimated to 
have saved over $10 million in FY 1975 alone (Referem^ 1), 

The suQcess of the CMI systea in the continental United 
States prompted and ARPA to become interested in extending the 

systets to Havy personnel at ^a or other resote locations. More spe- 
cifically, \he question- is being asked: Can further lisproveaents in 
resource usj be eff^ted by deliver!^ CHI supported training to job . 
sites? . ' 

2. Purpose and Objectives , * 

The purpose of the research project is to evaluate the cost- 
effec Wveneas of instructional" support delivered at job sites under the 
direction and control of a centralized CMI systea. The specific objec 
tives of the effort ace to deteraine: 

e Whether Ofa de^iv^red to resote sites produces the same 
learning ^fectiveness as CMI does in the learning center 
environ»eft 

m- Whether thejittitudes of students, trainers, and key r»ote 

site p<&rsonnel $re si^jportive of CMI delivered to remote sites 

• lAtether -OfX delivered to remote sites is as eronomical as CMI 
in t^ leai*hing center environments- ., 
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Personnel requiremerita 
% * Personnel trrinlng requireaents 
• Organization and sanageaent structure, requireaents 



Reaote site space requir«aent8 and operational procedures for 
effective- use of &J3a training support systei 

.Equipsent, aaintena^ce, spare parts, and logistics 
^ requireaents 



3, 



Proj^t Phases 

l-be research effort "has five phases: " a feasibility study; a 
deoonstration design; the deaonstration preparation; the deaonstration; 
and the evaluation of the deaonstration. 

The first phase- included gathering background data and infor- 
mation, establishing resource requireaents, and ^setting the parameters 
for tfte deisonstration; this wss the sQbject of the Decesber 1976 nZG 
■^rt Ko. 44 {Reference ?J . yhe ^nd phase, the primary subject of 
^is report,^ involve* deteraining the aogt useful abroach to conduct 
the deaonsfration. Jhe research approach to be undertaken ^ms defined 
and a deta.iled plan for its preparation, execution, and evaluation spe- 
cified. The third phase, a saall jfertl^ of which is pressed in this 
report, involves preparation activities; and. the fourth phase Includes 
the execution and* aonitpring of the planned xJeaonstration activities. 
In the fourth -ph^se, adjustments or changes wiU be aade as needed, 
data'and information -collected and prepared for analysis, and Initial. ^ 
analyses conducted. 'The fifth p6$^e involves suating op the .results of. 
■the d^ponstration, drawing conclusions, • and making recosaendations. 

It -should be noted fthat in order to insure that the develop- . ' 
aent and exepitioi of the demonstration is progressing satisfecto/ ily, - 
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a formati^^ evaluation^ is being conducted, Th^ purpose is to furnish 
project personal vith information helpful to thea in assessing the 
progress of the deaonstration. . < * 

B. Evolution of the Design 

I. Introduction ^ ' . ' 

the fundaisental research question posed 'at the outset of the 
OOMISAT project .was: Can trainings costs be re<3uced and the atanning 
siUiation of reaote job sites, sea or land; i>t i^roved by providing 
Oii training onsite? Tvo approeKjhes tor ^pl^enting CRI operationally 
were exploded during the feasibility stsxJy to answer this question. 

^ ■ ■ . I 

The highest pay-off potential was projected to invol« per- 
sonnel just entering the service \^ woold be^partially trained at an 
A-5chool and then be assigned to a re&ote sea or land site for the?e 
salnder of their A-School training. TtTe rationale was that: 

• The courses CKI were primarily suited for new personnel 
because they were A-School courses or preparation for 
A-Schoo^ courses * ^ ^ 

• Re<5?Jcing time at trainiT^ Jenters ^ould redi^ associated 
cos^ ^ile i^goving the manning situation, particuIarlT* on 
s^ps 

/ * 

• Operational' readiness possibly oould be improved by Mrrying 
the formal CKI straining with on-the-jc^ training {OJT) 

lb 

Sea sites were given priority because they were thought to be 
a *^worst case" envircxtment when considering operational requirements 
and their limited physical facilities. It was felt that if* It worked 
In this environment, CMI si^sported training may work at ai^ job site.* 

* - * * 

The secdnd approach %*as to provide Havy personnel already ai- 
signed to a job site with an existing CKI ocmrse that ifo^ld meet a site 
training need. The rationale was that: 0 ' ' ' - c , 

-■ \ . ■ 
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• Reducing the need for formal training vould reduce associated 
costs ' » ' 

• Reducing the abs^ce of personnel due to-'formal training • 
wOTld ijiprove the manning situation ^ 

• Operational training possiidy could be improved by providihg 
. and combining formal training with normal daily job duties. 

In both approached, five basic requirements bad to be set to 
execute a desonstrations 

• Approval for the of an existing cossunications system 

• Approval for the use of the U.S. -Kavy QG coc^ter facility 

at Killingtop, Tennessee 

a** 

• Seiecticpn of a validated CHI course 

• Identification ar^ cc^s&itsent of an operational site loz the 
conduct of the demonstration 

• Identification and ooemiti^nt of specific 0,5, Havy^ personnel 
to participate as subjects and to act in a support capacity 

? ■■^ . 

In ter^ of the-preferred approach, the first fcHjr requif^ents were 
^t. Tentative approval vas obtained to use: 

• ^ The standard Havy csn^unicatlons system to Include the Havy 

satellite systea, if required 

• TbelJavy Q4I ^f^ility ^ 

t / 

I • Th^Radioaan (RH) (XI course 

• KAVCOI*CSm Stockbwi (a ship cc^ld not 'be obtained) / 

' O ^ ^ ' ' 

Hevertbe'Hss, SUPERS di4 not grant permission for the personnel, CH2T 
had^ reqt>ested that proximately 30 new Havy personnel be assigned to 
the experimental gro^ t» be partially trained at tbe.4-S<Aool and ^ then 
assigned to t^ deasDStratioo site a)i additions to tbe'normal osi^le-^ 
ment of personnel* ^ • ^ 
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This was to insure that' the demonstration site would not be penallred 
by partially trained and 'lkB)q>erlenced personnel being assigned to reg- 
ular billets. BOPSRS saintalned - that by assigning additicmal person- 
nel in a single rate to a single site the billeting llalt would be 
exceed and, at the saise tlse, deprive other sites o^personnel. This 
is particularly critical in the RM field, where there is a shortage of 
pj^rsonnel. ' ' 



i 



ks a result of th^ BUPB1*S decision, the eecorvJ research appro* 
was pjrsjed and approval was obtained to user 

• The standard Kavy terrestrial oocsunications syfters CBecao^e 
Stockton was accessible with gcxxJ quality landllne the nee<f 
for, the satellite was eliminated,) 

• The Kaw facility , 

• Tne^^A-SchoSl^Basi^ Electricity ^nd Electronics fBB/Z/ CKI 

• K\VCD»4STA Stockton % ] 

• Existing RH personnel at Stockton 



2, Stockton !>eraonstration Site 

HAta)^5iSTA Stockton, like the majority of the operational * 
sites, has a grtat nusber of training re^uir^ents, but a limited b'^- 
get to seet these needs, Kany of tY^ courses are offered at locations 
a considerable distance fross Stockton, th^s requirirg absence froe the 
site of needed personnel and the expenditure of ^large stis of aooey 
each year for trave'l and per dies. The Stockton ooosander sees the 
(XmiShT project cxtncept as a possible approach for meeting soae of the 
Stockton training needs, — ^ 

i ^ ^ ■ - ■ 

» ' t))ere are a lliilted Tm2a^^er of U.S. Ravy bourses sup- 

port'ed by CK^ (all plated to A-School training), it was necessary to. 
find a mate* bet^^en Stockton training needs and a crfl coarse. 



» ^ 




20 



TAEG Report Bo. 49 

At the^sase ti*e the selected* course kust perait the fulfillment of the 
project i^irpose. " . , * 

I . 

3. Deaonstration Course 

KAVOOH-STA Stockton PM personnel have »,'speclal training re-' 
qui resent which provide? an opportunity to test in enlisting CW 
course, m'e are not required to Uke the A-Sdiool BE/B course. Ho^ 
• ever, as tice goes on they fir>d that a BE/E background can be useful 
both^ the job, and in taking'the electricity and electronics jjortion 
of the E5, and E6 rate advancement exaas. Exaa scores of Stockton 
- personnel provide strong evide/)ce of the need for BE/E, training. 

The eetb^ currently being used to acquire a background in 
electronics and eliectricity 48 to enroll ir, a correspondence course. 
However, this has not been a popular approach. due to the difficulty of 
the materials and t.>U self discipline required. An attractive aterna- 
tlve is to use t.^ie first 14 ©odules of the self-paced CHI supported 
3E/E course as the basis for, study. To Indicate .the potential interest 
in such an offering, the Ecjpcation Service Officer {ESO) at Stockton 

"X^surveyed site personnel and found 48 out of about 200 eligible person- 

^ nel interested in taking the course. 

• 

\ g Proar the OOHISXT point of view it was questionable that a 

cos^arable control group c«ild 'be established if the BE/B course was 
used for the desonstra'tion since personnel taki^ig BE/E training are 
usxjally personnel just entering the service. However, it was found 

. that thousands of individuals have taken the coarse, and that occasion- 
ally Navy personnel are sent froo their duty station to take the 
course. Consequently, it was rassaed tfiat the 'historical files would 
contaip a 8^a<ficient n\s±^r of individuals tljiiUr' to the Stockton 
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per«>nnel to ^establish a cofferol group, it should therefor^ be pos- 
sible to »ake a coeparison between the academic achlev«ent of person- 
nel returning to a training center for training, and those receiving 
the ^se, training at their operational site. Ose of the EB/B coarse 
«>uld also pereit the analysis of the cost differences in .providing the 
training at a training center and at the reaote site. Kith these ad- 
vantages, plus the need for B2/E training, the CW supported B2/E 
course was cAosen for the deaonstratidn. 

The demonstration, in addition to testing the delivery of CXE 
to an operational site, offers the c^jportunlty to cocpare the effec- 
tiveness of Oil and correspondence (burses in the same settir^. This 
will be done by having volunteers at Stockton outlying sites take the 
trlaitlonal correspondence course in electricity and electronics • ht 
the end of the deronstratlon a specially prepared exas will be given to 
both Oil and correspondence course graduates to compare what they have ' 
learned, in order to validate the exas, it will also be given to a 
control group with no formal training in- electricity and electronics. 

4. Attitude Survey 

A basic problem associated with iming "historical record per- 
sonnel* as a control group is that attitude surveys cannot be adainis- 
tered. Consequently, It is not possible to cceipare the control and 
experimental grpuf« relative to student attitude and resultant acdd«Bic 
achievement. However, it is possible to cc^re the attituSes of stu- 
dents toward CHI ^r se and toward receiving such training at the job 
site or at a training center regardless of the content. Fro* a control 
group point of view, this' can be acconplisbed by a<toinl8tering the at- 
titude survey to any_student returning fro© a job site to a training 
center to take any Qa supported training course. This' approach was 
dieted acceptable, i 
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5. Deaonatratlon Schedule 

The decision to use the Stocktorl s^te for the deronstration 
significantly ispacts the schedule of events by reducing the tise 
needed to execute the, various pnases. f 

Ac^rding to the schedule of events developed in the feasi- 
bility study, the preparation for the deiaonstration was to take place 
froa July through December 1977, the deDonst;ation vas scheduled for 
January through June 1978, and the evaluation was scheduled for ^August 
through Hoveaber. However, due to operational constraints at Stockton, 
including a requireiaent for ^ major training prograa {CX)KPARS) , the 
Stockton conzsander requested that the deEonstration be initiated in 
September 1977 and run through February 1978, This leaves two-Donths 
for demonstration preparation, July and August 1977, The evalu- 
ation pSase would run froa .March through June 1978, 
^ " ^ \ ' 

The design work in this docuaent 'reflects the change in 
schedule. Nevertheless, it is recognized that these changes say create 
a probles for agencies and organizations being tasked for resources; 
therefore, it Bay not be pc^sible to keep the schedule of events envis- 
aged in this report. Every effort will be sade to ainiaize the slip 
page. 

r ■ ' 

C. Deronstration Overview 

A representative sai^le of U:S^ Navy KM personnel assigned to 
NAVO^iWSTA Stockton wilf be chosen fro© a group of volunteers. Begin- 
ning in Septeiaber they will enroll in the cosEson oore ot the BE/E 
Course Pile 69*. They will spend an average of 10 hours of watch tise 
per watch string on the course until the oosaon core is co^leted. 
Since the course is self-paced, the tiae-to-<X3(iplete will vary for each- 
student, howeveir, the aaxisua time requirifd to complete the course 
sl>ould be no »ore than a. weeks. 
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. The students. will do their course work in an area set aside in the 
Fleet CoesBunications Center, where learning materials, equlpnent, and ' » 
8i5>ervi80ry personnel will be located. Periodically they will interact 
with the Millington, Tennessee ooapoter center through the use of an 
Opscan 12/17 optical readec and a Teminet teletype. Th|s Opscan will 
be used to feed test answer sheets into the coeputer for grading, and 
the' Terainet will be used for student feedback providing test results 
and prescriptive inforaation. 

During portions of the day and €ve watches a Learning Supervisor 
(LS) will be avail^le to address course and equipeent related ques- 
tions. Vfhen the LS is not available, the senior aaintenantf* elec- 
tronics technician (ET) will take ov«r these responsibilities. 

CcTOunication between the sttident and the computer center will 
take place using a cocssercial dedicated phone line between the Fleet ^ 
Cccs3anicatic«s Center at Stockton and the Kanageaent Iristructional 
Inforjsation Systeas Activity (KIISA) CHI concentrator at the training 
center at San Diego. HIISA lines will connect the training center at 
San Diego with the training center at Millington* ^ockton will be 
on-line with the CMI cooputec center froes 0600 to 1830 Pacific Coast 
tijse, five days a we^k. Materials developed at other tises will be 
saved and subaitted at 0600 the next day on which the computer is 
operating. ^ 

The correspondence course students at the outlying Stockton sites 
#ill also be permitted to study an average of 10 hours per watch 
string. At that xate, they should coeplete the course within 16 
weeks. Xfter coepleting the course, they and the QQ course gradu- 
ates will take the special exas on electricity and electronics. - 
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D. Organization of the Report 

The results of the design iork are presented in the fpllowing 
chapters: Chapter II presents the ecoiwoic rationale for the effort. 
O^pter III describes the research design. Chapter IV presents the 
demonstration design/ specifying the activities required ^ conduct the 
demonstration, carry out the research', and provide support in ter^s of 
cossunication lines, lab equipeent, course aaterials and personnel. 
The formal tasking required to obtain the support of different Havy 
organizations is briefly described^in Chapter V. The master plan Unk- 
ing the varrous activities is given in Chapter VI. Supporting aateri- 
als are contained in a series of appendices. 
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Chapter II 
V ECC^OHIC RATICWOE PQR COHTSAT 



A. Introduction 

An economic analysis of tHe^OOHISAT concept vra« carried out to 
determine its feasibility as em operational system. The investigation 
followed the guidelines prescribed by DODI 7041.3 and SECNAVINST 
7000. 24A fReference 3). The following section describes the key find- ^ 
ings of the analysis an4 presents reconaendations. This is followed by 
an overview of the methodolcJgf u^ed in the analysis.. The detailtf'of 
the analytical procedures are presented in Appendices A through G. 

B. Key Findings and Recocstendationg ^ 
1. Redjjction in Havz-T^t^jj^if^ Costs 

The analysis sh<>f8 that fuljl ijaplesentat ion of the COMISAT 
concept could result in present value net savings of 18 to 35 million 
dollars based on an eight-year prograa emd a 10-percent discount 
rate, - and depending on the set, of conditions assisaed as sbo%m in 
Figure '11-1. The top half pf Table II-l shows the incremental invest- 
»ent and savings-to-investisent (or benefits to investment) ratio asso- 
ciated with the savings for a representative ease. It should be noted 
that the present value saving estimates are probably low siru^ the 
analysis utilized conservative approximations of 'the economic benefits 
of COKISAT. 



^The present value concept, and tht relation .of present value to annual 
costs and savings are described in Appendix A, | 
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* MOST 
FAVORABLE 
CONDrrK)NS 
ANALYZED 



LEAST 
FAVOHABLE 
CONDfTlOHS 
ANALYZED 



EIGHT PROGRAM. 10% DISCOUNT FACTOR 
5EE TEXT FOR A DfSCUSSK)N OF THESE COHDTnONS 



MOST FAVORABLE CONOmONS » 

' • -t&W TERMfNAJ, BREAKDOWN RATE C3'YR* LANDSTTES. 
*^ 4/YR SHIPS! " 

• 90% OE SJOLL PROGRESSION COURSES ARE PRACTICAL 
; fORCMI ^_ 

• 20% OF STUDBfT TRAINING TIME IS SAVED BY CM! 



LEAST FAVORABLE CONOmONS^f ' 

, . • HIGH TERMtf^ BREAKDOWN RATE t4/YR. LAND. e^TR. 
SHiPSI 

• eO% OF SKILL PROGRESSION COURSES ARE PRACTICAL 

- FOR CMI ^ 

• 15% OF STUDENT TRAINING TIME IS SAVED BY CM1 



• •r 



Figure 11- U Summary of PotenU'a/ COM/SAT Savings 
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TabieU'h Characteristics of a Repre^taSve COMIS AT 
Program , 







Present value net savings {eight 
year program, 10% cfecount) 


- 

$29,777,000 


Annual Savmgs ' 


$10,858,000 


Incremental irtvestment 


$31,582,000 


Savings-to-investment ratio 


1.94' 


vperouonai 




rMumoer OT wmi courses 


• 


Number of sites 

— ships 

— CONUS land bases 

— overseas land bases 


411 
80 
47 


Number of students 


20,881 , . 


Proportion of CMTstudents 
served at sites 


96.7%"^ 



These savings are achieved by usirtg CMI to train personnel 
who normally take skill progression courses the training center 
which requftfis a permanent change of station (PCS) or temporary duty 
{TDD as8igr»ent. The major- source of OMtSAT savings is the reduction 
In travel and living expenses achieved by having the stddent's reaain at 
their c^Mtionai land site or ship.^ The analysis shows that on the'' 



An explanation of the calculation and interpretation. of .annual savings 
' can be fouhd in Aj^ndix A. 
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order of 30 percent or store of skill progr^ession students who ordinar- 
ily travel to a training center o^ld be served by COWSXT.^ .This 
■eans that aore than 20,000 studehts a year, representing .ore than one 
tenth of the total maber of Navy students trained per year would be 
affectedc The bottoo of Table ll-l lists the n»ber of slt«s and 
trainees served foAthe reprtfsentat;lve case. ^ 

The uncertainties which account for the vau^iation in the 
above results have not been resolved as discussed in the next section. 
However, even the lover values of savings are large enough to warrant 
serious consideration by the Navy of impleaenting COKISAT, wd are cer- 
tainly large enough to justify the pressed demonstration. 

These conclusions are als^ iBport;ant for the other services. 
If equivalent savings can be achieved for each of the oth^ two ser-' 
vices, which is reasonable to expect, then total Defense Department 
savings could have a present value of between 54 and 105 million dol- 
lars for an eight year prograa. 



Dncertaintxes 

The variation in the savings quoted above is due to urvcer 



tainties in three areasj 



It is not known what percentage of Havy skill progression 
courses are suitable for conversion to CMI. Values of 60 to 
80 percent were exaained in this analysis* A value of 70 
percent was picked as nominal based on discussions with Havy 
-training personnel and a review of courses. A 10 percent var- 
iation was used to anal^e the sensitivity of the results to 
the noeinal assusptionsTV,^ 

The fre^ncy of tenainal breakdowns under operational condi- 
tion on land and at sea is not known with certainty. Manu- 
facturer estieates were increased by'one third on land (frod 
three to four per year) and one'Jialf at sea^ (froa four to six 
.per year) to assess the sensitivity of the results. 



1 



An 'e3q>lanation of the calculation and interpretation of annual 
savings can be^ found in Appendix A. 
^ • 16 
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The aaount of studwt ti»€ saved by haviDg CHI instead of 
conventional, instruction is estimated between 10 and-^0 per- 
cent fRefer^1r>ce 4)* Both cases were considered here. 



The analysis shoirs^ that the resultant change in, savJnge^t- 
trtbutable to (1) thef change in annual terminal breakdown rates frtw 
three to four on land* and four to six on ships, (2) a 10 percent change 
in the proportion of courses con^rtible to CW, and (3) a five j«cent 
change in studen^ time savings with (XL would each result in a ch^r^^ 
of about five Billion ^^llars in present value savings. That corres- 
popfls to 2m annual change in savings of about one million dollars. 



Table II-2 lists the results for the two cases which were 
developed in the greatest detail. The cases sh6w the effect of diffe- 
rent recite site termi^nal Jj^eakdown rates on the savings achieved, the 
nursber .of courses tPjat can be delivered, and on the number of ships and 
land sites served. 

Tsd^i I hi Summsry of ResultX 



Itsm 


Low 
Maintenance"^ 


High 
Mainttnanc*" 


Number of CM! courses 

Number of shes 

- ships 

- CONUS 

- oversea 

• 


89 

* 

535 
Ait 

80 

47 


67 

434 
328 
66 
40 


Proportion of CM! stUd^^ ^rved st the &tss 


96.7% 


S2% 


Annual r>et savings 


«1O.858,O0O 


$10,190,000 


Present value of savins (eight year program) 


$29,777,000 ■ 
: W1 .582.000 


$26,384;000 
$32,096,000 


Incremental ^^^i^^^^^^^m 


Savin^to-lnvestm^nt ftatio 


T.94 





Munm thtt to higher br^tiutown r«M tptrt tt^^ 
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There is a decrease of f iVe trillion ttjllars in present value savings 
. for increase! in breakdown rates of one third on land and "one -half at 
•ea. The greateiBt i«pict is at ^ vhere p fewer ships could be 
served with the higher break<iUn Tates. The naber of courses that can 
be delivered decreases froa 69 ,tb because of the higher «intenance 
costs. In both cases, «ore than 90 percent of the stodenU who nor- 
Bally travel to a training' center to attend, the feasible QC courses 
would receive the training at their base or ship. 

• These two^asea. assume that 70 . percent of Havy skill progres- 
sion courses are op^racionaUy citable for conversion to oa, ^nd that 
Oil requires io percent less ti«e than conventional instruction. The 
effect on savings of varying the latW-two assuisptions is shown in 
^^le II-3. A 10 percent change in the number of courses suitable for 
a« results in a change in the pre-«ent value of the savings of about 
five Billion dollars. 



/ 



Tabfe 11.3 Sensrwrty of Present Va/ue Savings to Tme Savings and CMI 
ConverbbilrtY Assumptions L Maintenance Case 



Percamage of Skill Progrwtion 
Courses Convertible to CMI 


Percentage of Student Time Saved 


10% 1 15% 1 .20% 


70% 

80%' ' ■ - 


$17,627,000 . $21,326,000 f25,OS,000' 
$21,770,000 $26,085,000 130,401,000 
$25,913,000 $30,845,000 t35,777,000 

* 



1 H*lC«.tt»» numb* (Sffefitiflfttty from th«p(««Hvifc«»v«)Sifi^ 



y 
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The effect of a eh&rvge in stodent ti»e savings to tbe use 
of Q41 Is greater vhen there is a iiighy f fOi»ctiOT of oxtrses suttkble 
for conversion, l^en 60 percent of^ti^ skill progression courses are 
suit/ibae for CHI, a 10 percent chaise Irr student tiae savings * (free 10 
to 20 percent) changes the present value savings by $7,398,00rf <fros6 
S17,S27,000 to $25,025,000), to%#ever, vhen 8^ percent of tbe courses 
are convertible;^ the saae change in student ti»e ;;savings ^langes the 
present Tali>e of savings by $9, 864, 00*0 ^roe 525,913,000, to 
$3^,777,000^ \^ ' . 

The lo^st estimate of present value ^vings is 14 sillion 
<5ollars, assinlng high saintenarvc^,' SO percent course ccx5vertibllity to 
WI, aj>d 10 percent stjdent tise savings with 0€I*| 

The savings results are sensitive to other assj^Jtions, but 
not to the sase extent as ttos^ just' dis<nissed» F^r exasple^ the re- 
sults in Tables II-l to II-3' assi^ that land sites vithin 30 miles of 
a central location can be ^rved fay one terminal at that location. 
Courier service ^jld carry inputs to the terminal and return messages 
to the base. If that is not feasible, present value savlsgs vould be 
.reduced by one^milliop dollars* _ a 

C 

3, Coe^unication llequtt>faettts ||r 

^ AiK>ther concern is for the availability of csaesmlcatioss 

lines. ^ Kb the nosber pt^QU students increases, tbe capacity remjired 

will increase tbe Havy to a g ^lcations reqdtred, partlcalarxy frcn tbe 

QCI cc^uter to the r^i6tf sites. '<To assess. this, tbe opacity re* 

1 ' f . . 

quired *^s estimated^ based oo thm cbtra^teristi« of tbe Qd aes- 

i, • 

sages. The total comun ications load jst tbe avi^?^e site is estimated 



1 ^ ^ 

See Xppendix B. 
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AJTTOOIH JI system 

4. Re<xter^tlo rts ^ ^ 

SiDce the eccraic analysis al^ l^rge pdttttial savings, it 
Is i^rtant to test a major asso^ion, i,e., that' tbr OOKIS^ conc^t 
is ^rkiable at a reaote si^, it is necessary to sbw that stgjporting 
|>ersonnei assigns^nts can be carried o^t as ass«ed for the analymis, 
that stodents can taice the time on site for trailing, and that, xxr^er 
tho^ ccf>dltions, -l^raining is effective. ^ desc^is^tratic^ pro- 
posed in this docoi^t ^jld ^Ip cx^f ira that the *cxr>cept is pr^^ical 
and desirable* 



, Afcdditional investigation of the economic bej^efiu of OXlS^t 
should be ox>ductedi ^ ^ . ^ 

• The Kavy courses sho^jld be surveyed in detail to determine 
sjiitability for CHI, enrolim^ts, and l^ths* ^ 

• ^ A better approximation of equipment br^aXdws mtes shcrjld be 

obtained. In the event that thwf rat#s are higher thfo 
those in the high mainterrf^ case explored here, th/manu- 
facturer should be c^snsulted in an attempt to improve main- 
tainability characteristic. 

Xn mvestigatiCKi steald be m^ to determine vbetber th^ 
'average travel and living expense used in this analysis ^e- 
quately reflect the range of costs ^ the usual payment * y 
proce<fares', 

' a The availabUity, cost, and feasibility *of courier service 
betvecs nearby sites sbcmidi be investigated to obtain an tm- 
prpved ^timate of the extent to ^Icb clustering of sifces Is 
practical and profitable. ' % 

• Tbt avaliable -c^^acity cf st'each site should ie as- /- 
»e»ed to insare that the sdditi<anal de»arei doe to OOHlSht 
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can be aisgij&feely wet. • In particular, tte J^tTKOIN II • 
gity tp the Qa oo^xrter will have to be large ^x>:^ to ac- 
ocmmdate the jierw load.l 

C. Background arxi Approach 

^ . Ihsre a5=e Navy eoorses in self-pa^ed instruction fornat, scne 

of which are already programaed onto the OCE coEpatir at hfen^iiis ara avcdl- 

^ for on instruction at locations ^jch as hfesphis, great Lakes, San 

Diego, ^ C^Larrio. In the future, QST ints^is to expam tte CKI 
capabxlir/ by: 

• Develcpii>g and pro^viviMin g arH-rf-ir?\Ai courses mto CKI 

• Enlarging the CXE ccr^itex to ^xccntx^te the increased 
course 4sm studsit Ics^ 

It IS possible that the OOES^ project coolci play a ,signxficant role in 

the^^futxire plans^^^^e need tor an ^ii^irt^^ trainii^ carter arxi the 

operaticris of tte exxstirsg training cotters nd^xt be iitp^rted. 

The befits .^rfxsjch ooold be expected frxm an irolesantation of OCEOSftT 
utzlude those at±2ributable to CMI and th::^ attribat^le to renote site 
traipong. Naval expen^Tce (Refers^ 1) indicates that utilizaticn of 
on at a (trainii^ ce n ter yields: ' ~' 

• A re&ction ^ cxxirse Hrr^ ' 

• A ra^s^ticn vOf instructictal ancj ^gpoar t pefsxinel 



ERIC 



^Ihs net cxjst of ttese new lines was ai^tiiBd to be tte ga pp as tte 
additio n ^ a.mnjnic ettioca cx»t for the CMI Q'steai enlarged to ti^ c Iav ^ 
these ^dll pr ogression oourses, 

21 




• An increase in student ena-of-course acBleveaent levels 
t A redoctlOT In 8ti>dent attrition. 

Th4se benefits ccHjld also be expected from CHI at operational Navy 
sites. In addition, COMSAT would allow the student to remain oji the 

job whil^e training, thus resulting in: 

e " A saving in travel and living cost 

• ^ Training for personnel unable to leave the operational site *J 

• e An increa^gfi in the availability of key personnel to handle 
cont IngeiKies at the site 

The elerreats of cxkst and saving involve$3 in achieving the 
above benefits havi& never been ooe^ietely defined. Determination pf 
important cost elements was a necessary step in the ainalysis procedure* 

^ Table II-4 contains an overview of the* elesejpts of cost and 
saving used in this analysis and attributable to thf CX3KISAT systes as 
compared with the ^ventiorvalAMI systes. Certain courses can be eco^, 
noslcally justifi^ for Ofl development by savings- ajt training centers,' 

only cost to C30HISAT of utilizing these- courses at rerote sites is 
the cost pf the site tensifials required. Savings achieved by offering 
these coorses^ thrqugh OOJ^SAT include student travel and living costs 

' and the reduction in terminal cost at training centers. Other courses 
could not be economically justified^ for \x&9 only at training centers, 
but could be justified by' savings a^ieved through COKISAT. For such 
courses the costs to OOKISAT include not only the site terminal cost 
but also tffe^CHI course devef op il t nt, coding and maintenance costs, and 
corsputer leasing costs. Also, additional terminals required to te^cb 

'these courses at the training center to students who cannot, "be reached 
through CCMISAT sust^ considered under OOKISM costs. The' savings 
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y Tdbh /M. Sufrtmary of COMISA T Casts and Savings Bements 



— 




CoursM Justified For 
Tralnlrvg C#ftter Uw 


Ar:3dttionaJ Courses Justified 
OnJy By COMISAT 


f 


Costs for 
COMiSAT 


f — ' 

Terminal cost at $jtfe 


Tenninsi cost at addl- ^ 
tionalsHes 

Course devetepmen^ cocfing . 
and makttenan^ 

Comptrter Jeasing 

TraWng center terrrenafe 




Savings dye to 
COMISAT 


Travel and 6vr>g costs sav^ 
by recefvir^g training at the 
op^ationanand ba^ Of ship 


'Tme and &vk>g costs sav- 
fed by CMf over converv* 
tjoriai irtstructjon 


* 


I* 


Reduced r>urT^>ef of tratn- 
iog center teminais 


Travel and fevir^' costs saved 
by recefvirvg trainmg at tfie 
^ operatky^^ land base or ^ 



credited to COKISAT for the^ courses consist of the student travel and 
livir^ expenses eliminated by training at the site^ and tiae ind living 
savings gained through decreed student training time. 

analysis of these cost elesenta consisted of four steps: 

♦ Determine courses ecorx5aically fe^i^e for Oil at training 
centers 



ERLC 



Deterslne econoalc&Uy feasible COmSKlj^iXeB tot delivery of 
the CMI courses justified for use at training centers 

m Using the sites Identified in the second step, determine ad- 
ditional oa courses justified by COKIS;^ savir^s 

s 

• For the cos^lete -seiT of training center-justified and 
COklSM-justlfled 0!I courses, determine the nuaber of 
OOHISAf sites for ^Afc^avlngs are iwximized. 

♦ » 

Each of these steps are discussed in detail In the next sectioK^ 
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2. The Approach 

a. Deterainatlon of Courses Economically Feasible for OC 
at the Training Cen ters 

a ^ w 

I {1} The Pourses 

The^irst step taken in-aftalyzing courses for CHI 

developeent was to obtain data on overall training enrollments and in- 

d5vi<Jual course enrollaents. The necessary data on annual overall 

training loads" is sisaarized in Table II-5 {Reference S)^, 

Six distinct training segments are identified by 
^his data. There are three categories of courses offered: initial 
skill training, 8k ili progress^ion training, and functional training.. 
Initial skill training consists of Class A courses^ offered iasaediately 
after recruit training* Skill progression training is aade up of laore 
advanced Class C type courses, qffer^ to sailors have already had 
soc^ work experience and are preparing themselves for an advanced %at- 
ing. Finally, functional training consists of short duration training 
of shij^ard duties given at the ports of fleet concentration such as 
San Diego. 

Tbere^are also two type^ of students: those on 
pe^-manent change of station (PCS) and those Gcr tesporary duty (TOY) . ^ 
Those on permanent change of station include recruits going fro© re- 
cruit training to a training center and then to fleet or shore sta- 
ticM^, emd sa-ilors going fro© fleet or ^bre stations to a training 
center and then to new duty stations. Tes5>orary duty occurs when the 
sailor leaves his station for a short period of tise, such as to go to 
a training center, and then returns t& his persar^ent station. 

The most likely candidates for COMISAT instruction 
are those takiig 'Skill progression training. The students in these 



^See Appendix C for osj^nal^data 
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TMbh 11-5, Hwy PY 7B Tnining LMk 





As 


TOY 




Initial Skill Training 
• 








1 Entrants 

2 Graduates ^ 

3 Aver^^e Courw Length (dayt) 

4 Loa(Js Average on Board CAOBi 

5 Perctnia^e of Loach^ ^ ^ 


157,833 
156^3 
42 
19.152 


6,269 
6^14 
42 
570 
2% * 


164,102 
42 

^ 19,722 
59% 


i 

ProgretSJon Traiomg 








1 Entrants 

2 Graduates 

3 Avera9e Coors© Length fdayxl 

4 Loads Average on Board (AOS I 

5 Percentage of Loads^^^ 

• 


* 30,042 

51 
7^74 

22% 


32,867 
32;530 
51 
2^6 
8% 


62^ 
61,566 
51 

9^ iw 
30% 


Functional Training 








1 Entrants 

2 G^adiiates 

3 Average Course Lengtti fdaysl 

\ 4 Loads Average on Board (AOBI 
5 • Percentage of Load/^* 


22.226 

21.61 1 
4 

"1,224 
4% 


329;j40 
4 

2^3 
9% 


35i,566 ' 
4 

4,097 
13% 


r 

f G^'and TotaJ 








1 Entrants 

2 Gra<foates 

3 Average Course Length (days) 

4 Loads Average on Board lAOB) 

5 Percentage of Loads^^ 






578^77 
5^J83 

33,619 
100^' 



,( 1 ) P*f c*ou9t cr^ io*d* • pefc»m»gt of tot** ChFT popuUton trtr^ltd 
12) A 7% error e>ut 10 £Oune$oH n fourtd if ^ ir>^v)dual Rumb«r< art atfdtd 



groups are productively esployed befort ti^lr tr&Jning and could con- 
tinue to, carry out their dutles/ although at a -r^owd level/ if they 
were tb receive training on board ship or at a land baset The group 
taking initial skill txainirq on TOT was not J,ncl«>ded in the analysis 
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ev^n though it sight actually bervefit f roa 0C3HJ[SAT, because it is rela- 
tively saall arxJ data on init^Al skill courses are not readily avail- 
able for use in this analysis. Initial skill students on P« are not 
likely candidates for CMI because their lack of skills makes them of 
little use while training at the site. Jn this regard, operational 
coEssanders have been found^ oppose the idea of placing untrained aen 
at their sites or on^bo*rd their ships. Finally, functional training 
segments are not considered in the ^tudy since this instruction is pri- 
marily port-side teaj? training and is essentially delivered to the 
renote site already. Hence, in this, analysis, the only students con- 
sidere<^ as candidates for COKISAT are those in the skill progression 
groups. 

Having identified the candidate training segment, ' 
the next step is to' obtain data on course enrollsents. The c^y ob- 
tainable data on individual enrolbsents for skill progression courses 
are the title, nunber of graduates, and course length for each oi^e 
ten highest volooe skill progression courses (Reference S) , Jiverage 
atter^ance and student san-days have to be estimated.^ The derived 
enrollment information for these 10 co^lirses is gijpen in Table 11-6. 

Enrollment data for additional courses are gener- 
ated by fitting -a curve through'the known populations for the 10 high- 
est voliHse courses and exti^apolating . ^ 



With all data on enrollment and course length cob- 
plete, the courses eligible for conversion to CKI are identified by 
calculating and cosrparing costs and savings to -determine those which 

- « 

1 

See Appendix D, 

2 

*See Appendix D. 
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Tabfe Ten SpecMied SkM Courses Producing Most Graduates 



rttJt 



of Gradf 



Ay«r*9t 

Atttftdetcft 


Ungfth 
{Ci(«ndar 




3,141 


24 




i;538 


26 
182 


34,736 






970 


117 


113|490 


617 


53 


32,701 




182 
82 




592 


48,544 




182 










40 


- 15.200 


404 


28 


1i;312 - 



1 Instruaof B4$tc 

2 Caretr Informrtion Coumeior 

1 *Nuclc3f Propt^iion Piant Operator Mechantcat 

4 Sonar Electronics lntern>ed>ate 

5 Air Cood»t»ooir>9 afKj Refngeratjoo 

6 *Nocitar ProptHs*on P^am Operator Elearical 

7 fnte^-'^twat Mo*^ Co<Je 

8, *NacJear Propa{s>oo Plar^t Operator Reacux Contro* 

9 Mar ne Gas Tu'tjtrw Bas*c 

10 Surface Explosive Orc^y^cc Dupovsi Refresher 



3,110 
i;j23 

i,m 

960 
611 
608 
586 
612 
401 
460 



Tota* (10 CourmI 
"Pbtal {7 Courses) 



9^ 
7;J91 



332 ;»7 



'^Not tu«ttt^ for CM I lorfnti 



have a net savings.^ The following two sections describe the proce- 
dures and assusptions. 



(2) Costs at thg Training Centers 

The ^^e^^^associa ted with the transfer of tradi- 
tional courses to OH for training center use include development and 
cx>ding, course eaintenance/ cosput^r leasing, and terminal purchase, and 
aaintenance. Before a course can be made available on CHI, it must be 

iloped into the, proper CKI fc^rmat and coded for the CMI TOcputer. 
Assiaing the aiaterieas are" "less • than 10 percent audio visual, the de- 
velopment ^cost is estimated to be $2,930 per instruction 



See Appendix E* 
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(References;. The cost of coding is between $200 and $30? per in- 
struction hour, ^* a mean coding cost ot $250 per hour is used in the 
calcoWtions. The estimated total 'developcaent and coding cost per hou5 

$3,180. However, since CNET is planning to redevelc^ courses for 
some 70 to SO^ratings in the next 4 to 7' years, those courses would 
cost -^1,130 per hojur even if they are r>ot developed for CMI, This re- - 
suits in an 4nareaental cost^^per hour of training f^r developing a CHI 
course of: • < -s 

$3,180 - $1,130 « $2,050, | 

It was assumed thafe by ejcpending five percent of ^he incremental de-- 
velopraent and coding cpsts {$2,050 per hour of training) each year, the 
CKl program can be adequately maintained for 12 years fReferefice 6). 
For an average cpurse of 255 hours, annual course maintenance is 

' (255) ($2,050) (.05^ » $26,137, 

The cOTputer Leasing costs have two aspects ' 
(Reference 7): expansion of the^comput-ft main frame, and ejcpansion of 
the number of perij^erals, par^ticular ly the disk packs. The current 
main frame accomnpdates e^Wfi'^erage on board (AOB), The planned ex- 
pansion to a Model 60 computer will have a saxiBum capacity of 16,0W~^^ 
AOB Studepts, It is assumed that this "expibnsion wDuld accocsaodate the 
additional skill progression courses. If the assuffiption is not true, 
the cotnputtr could be expanded to^ Model 80/ «tfe additional cost. With 
the current mix of courses on the compuilyr, one disk pack would be re- 
(juired for each additional 1,000 AOB jatudehts, assuming an average 
one student response per hour.' This would cost $800 per month. How- 
ever, if the volume of students per course decreased, as it would if 
many additional courses were added, tf)e requirement might be aore than 
pne disk Rack per I, OOO- students. For pur'poses of this analysis, it is 
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Jssumed that an^ additional 1*5 disk packs would be re^^ked for each 
^000 students. Note that the final results ha^e low sensitivity to 
the required number. of disk pack3 so that the relatively arbitrary na- 
ture of the figure used is of little conffeqwnc^. Thus^ the annual 
cost of disk packs for each l;000 AO© students is approximately 

($800) (12) (1.5) « $14,400. ^ . 

^ Since the coaputer mainfraiae will t>e expanded whether or not it Is used 
for CMI, no computer expansion costs are incurred by developisent of 
courses into CMI, "Therefore, the only computer cost involved is the 

f le.asing cost of the disk packs. 

The purchase of terminals iSHs^Aper than leasing, 



5^ 



^ based on the data in Table II-i7. The purchase p^^e for the terminal 
cluster is $14,250 emd the annual maintenance is $1,764. The present 
value of the maintenance over eight years i8-$9,873j» 

't , - ; 

One cluster is usually required for each 60 stu- 
dents, and it is assumed that clusters could be shared. "^Yherefore a 
proportional cluster cotft is assigned to Wch course on the basis of 
the AOB student load. A course with 3& students would be charged half 
the cost of the cluster under those circumstances. 



(3) CHI Savings at the Training Center 

The savings achievable by impleaenting OH courses 
at a training center accri^ for the most part from red deed student pay 
and living costs dDe to dedraa^ training time* There are iDther 
sources of savi^^, ^ch reduced instructor tiafe, but those are not 
considered significant enough to' justify the additional effort requited 
to ^include th» in the analysts. Hence the savings identified here are 
conservative estiaates, • ' 
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Tabfe II- 7. Navai Training Center CMI Cluster Equipment ary^ Associated Costs 



Item 


PurchMdt)ptlon 


Ldase Option 


lnvMtm#nt 


Maintenance 


(per month) 


* 1 ■ OPSCAN 17 (Baste TerminaU 
Maintenance 


t 8,938 


$ ®/n>o. 


»261 
69 


1 ' OPSCAN Automatic Feed 
Maintenance 


652 


5/mo. 


27 
5 


1 - Tem^inet 1200 
Maintenance 


4^ 


68/nK). 


132 • 
. 68 


1 ' GDC 202'9D Modem _ 
^ 1 Maintenance 


400 


5ymo. 


13 
5 


Totals 

^ 


$14,250 ^ mi/wo 


$580/mo. 





Presearch Corporation* s «malysls of eight courses 
that underwent Instructional System Developes^ent (ISD) type developcept 
shows an average saving of 20 percent of student man-hours of atten- 
dance tijue, as coiapared with the tiae- required using traditional In- 
structiory-fReference 4). This planning fjctor is used throughout the 
analysis, and the sensitivity of the results to the parameter is tested 
as described in Section B* Using the 20 percent student time saving 
factor, the 'man-hour savings for each course are converted into equiva- 
lent student salary savings.^ ^ * 

^ While attending a training center ccftirse a student 
is provided food at the sase cost to the Navy as at his opefj^tional 
site. However, he or she is also given $2.$0 per day in cash to cover 
aiscellaneous^ o^t^of-pockert living expenses. Due to the reduced 



See Append i;t Z. 
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1 
3 

3 

4 ' 

S 

6 

7 

8 

9 

10 

11 

12 

13 

t4 

IS 

17 
18 



Tcit»l64«?0 
7< 



7Jt1 



Toof flcja 7 



Hcxt7€owrm 
7p*ui70%or 



9^ 



91CU5 
3^.75 
»77«2 

1.tMJ57 



f4 



3.110 


3,141 




206-5 


I 246,000 


649X>U 


i8jC771 


6l23j000 


\:sn 


— 1336 




• 9S.1fr 


Z26J500 


Z2jB06 


2^ 


13^ 


960 


970 




3108 




73J815 


9.128 




eii 


ei7 


296 


89jeo 


543J290 


18J530 




27.162 


£86 


692 


410 


1»J 


6KtjK» 


22^ 


4^067 


<2;0E25 


401 


406 


200 


44^ 


410^ 


10J&40 


1;305 


20J900 


400 


404 

431 


140 


3QL99 


297;000 


7^ 


6t1 




447 


255 




522;760 


ujgei 


ija66 


28.137 


427 


255 




522J80 


14^2 


\jn 


»*f37 


400 


♦13 


2S& 


57.71 


522.760 


13,706 


1Jfl97 


26*137 


3»3 


397 






^,750 


13.172 


1JS31 


26.137 


371 


3e3 


2S5 


S3>I9 


622,780 


12.704 


1JS73 


26,137 


see 


370 


256 


5148. 


62Z7S0 


12;a67 


1316 \ 


26*137 


3se 






; 66.1 


522,760 


i'i;»e 


\JO% \ 


28.137 


343 




2S6 


464 


522^ 




11423 / 


26.137 
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Ml 


]i 






mm 






S7iA4S 




$ 4T44I2 


(41M81 




MS4.1K 


t2J5<2j573 


38J2S3 


2.wjru 




n.4»4 


»7j9t6 






17J70 


»A11 


1.1713M 


41>U1 






7XS7S 


4nj9Q6 




S2e^45 


SS.721 








- 2;rs»?^ 


1^ 







732^ 


\m/tn 


tOJ62 




1.102383 




4d^J9C2 

t 
/ 




47J»7 




tJ4i;»14 


288.130 






1J838JS99 


^30ja98 


i ^ 


. &39 


22,444 




S46,tS9 


88;&03 




8X09 




S48^ 




83.758 


83J8D 


4«6 






3«2^ • 


62>t98 


S;858 


88,152 ^ 


J81'M7 


44*28 


43JR4 


9» 


28J9Q1 


*n.73^ 




127^ 


11^12 




77M10 


81^ 


188:208 ^ 


8» 


26,777 






t2i;518 


I0J87 


mj5i3 


741^ 




t24jn8 


• 831 


28«0O6 


IOO/(44 




ntj83 




t28,025 


iKjm 


81 ;» 




7B9 


2S;&e7 






nijMO 


10.121 


12} 


882^8 


81 M 


88jM 




770 


28^ 




MM 


107 


9.7«2 


t17J18 


^,308 


81^ 


4<7»4 


7*4 


29^ 






104.168 




1.t38» 


838^18 


81 ;» 




771 








101^ 






818W 












602^ 




8^ 
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training tise, 20 »percent of tbeae living expenses are save3^or 
course . 

The total cs>sts arid avings ao^ated in this sannef 
are discounted over -eight years. Since the development and codir^ in- 
vestment produces a course with a lifetiaie of twelve years, the dis- 
counted residual valje of development and oo3ir>g is treated as a credit 
to CDHlSkT. Therefore the resulting present .values oonsistently repre- 
sent ah eight year program.^ Kb Table II-8 indicates, thfs techj^iq-^ 
identifies the top 1'^ cojrses as feasible, for QG develop:^ent-, Bo^ 
ev%r, three of the first ten courses are nuclear trainlryg, and it is 
ass^ed that these would r%ot be operationally practical for CHI. This 
saiie' planni-^ factor is applied to courses 11 through 1*^; so, on the 
average, only "^O percent of th^se courses are <x>nsidered to have poter^- 
t^al for cm: developc^nt ai^ only 70 percent of these net savings are 
credited to Of I . The analysis of the sensitivity of the resjlts to the 
valje of this para^ter is discussed in Section 3, 

b. DeterBinaMon of Feasible COKISAT Sites - 

Isplessentation of Oil at the training centers results in 
net savings. COHISAT provides an opportunity for a<Mitional savings by 
delivering the courses to operational land baser and ships^ and elisl- 
natir^ travel and living expenses of the students. Certain costs -and 
savings occur to the saae degree through both COKISAT and, CHI at the 
training center. SixA el^ents do not aid in differentiating between 
the two alternatives and were not explicitly calculated in this analy- 
sis. Bence, |tbe «>st el^ents discussea below consist entirely of dif- 
ferentiating costs and savings. ^ 



See Appendix h for a description of residual value and the aethod of 
computing its present value. 
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(1) , Co*t%.tO CCtQSJlT 
r The co«t» to OOWSW consist of the por<A*»e or 
iMsing pric« of the terminals,, t^ cost of ennutl MlntenuBce, end the 
cost Of software changes to the oa ooJipote?: required to interface vith 
AOTOOIH. The required equipeant and its eons can be foond in Table 
i:*5 (Reference lU Each terminal ihrs ass»ed to ba;.* a lifetime of 
8FPprcrxisate2y eight years. Since leasing over this period »ls etfch 
»re expensive than pyr^ase, only the purchase option is con!»idered in 
this analysis. Quantity discoonU are available as found in Table 
n-lC aefererx^ 8). The saintenance coits in Table 11-7 are for sites 
ir. the continerta: Cnited States (C0S3S; 50 Biles or less free an 
Opscar service location., other CX3^ sites wy be 'maintained either by 
Ops car. or by ^specially trained Hsval electronic techniplafts frr's}. 
Overseas and^ sh;p sites cast be serviced by ST's.- 

, ' r^^./S COMJSAT T^^^rw^a,' Ei^^pm^t ^ 



1 — 


1 

* Pur chfts^ Option 


L**f4 Option 
(per month^ 




Matntenanct 


i 


[ % 8.998 


m 


m 




; S2 


S 


27 
5 


i 

j 1 " DfiVfC^ 273 








i 


i 

180 




74 


Ma^ian^^ of tot^' e:^^;mwm 




6 ■ 


.6 




•11.^ * 


•80 rco. 






t 6.S23 



4 
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T^b^e 11-10 0PSCAf4 Discount^frorn GSA 



i 

t 

}- 


Unrtt j 


Percent Jifcscoum 


! 
1 


1st' ' 


<» 

0 








i 


31sT- aXh 




i 


61st • ^ . 


'5, 1 


i 


91st.12C^ 


20 ; 




121SI- 150^ 


1 




I5l5t- laOth 


30 ' 




181st -210th 


35 


i- 


2l1tin oo yp 





greater 



The cost of service by Opscan personnel for sites 
bhan SO sjles free the service center fReference 7*. consists of: 

Travel costs of 18^ per sile 

Labor cost of $30 per hour, ir>cludir>g travel ti©e 

An approximate annual parts cost of $S00 obtained free 
Opscftn's price for a service warranty 



Labor co^ calculated assisting a i^an tiae to. 
repair of 2,5 hours p>er breaXdovn, 

V Service an ffT inwlves the fclloving costs: ^ 

# An approximate labor o>st of $75 per breakdown, assueiog the 
sase total Opscati iJbot ccmt per breakdown as for Opecan 
wlntenance persc^el 

• An approximate anmial p^tm costs of |400 per year based on 
the price of a service warranty with a 30 percent return on 
investment reaoved 

♦ A spare parts inventory which can be purchased at an • 
undiscounted base price of $6,529 
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Tbe Opscan «aintenance cott on a ti»e and MterUls 
basis is less than tbe cost of tbe Havy MintaJning the equipment it- 
self for COKDS sites less than 90 «iies free an Opscan service *. 
center. 1 rive p»tegories of sites, each Wth different wintenance 
costs, are derj;*d in the analysis. - These categories and their eight 
year discounted .maintenance costs, .assuming three breakdowns per year, 
can be fojreJ :n Table ll-ll. 

Tab^e I' r 1 S.ie Cst^or^s and Present VaJue Maintenance Costs fortheLa^ 
M*a^ntenance Case 



Con 

ftn 8 ytt' 
pf«*m r»iue 





i 




S2718 










• 


1 259 






. , Si,S79 . 






3,358 


2.2:^ 


2.239 


2.^ 




SS373 


6.8:^ 


3498 


3.4^ 


4664 



(2) OaSAT Saving s 

The COMSAT savings which were considered in this 
analysis consist of student travel costs to aivJ froe the training cen- 
ters, student living costs tfhlle training at the trainin^centers, and 
fraining center tersinals which. would no longer be required. Travel 
cost is assessed differently for PCS students then for TDY students. 
The travel cost for a stodent attending training on TOY includes round 



^ See Aj^ndix P. 
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* 

» . - ^ 

trip travel f'roa site to traini'ng center andtaeals required during tra- 
vel time. One-way travel expenses fross site*to training center, plus 
aeals during travel time, are required for a student attending training 
on PCS. Also, when a sti>3ent on PCS travels to attend a course of un- 
der MO days duration, he Is permitted transfer of tousebold effects at 
^ cost of 5291. This asount Increases If the tlse Is greater than 140 ' 
davs, y 

Practically all travel cost Is a function of t]^ 
distance between the original station and the training center loca- 
tion,- Since the exact aUeage dlstr ihnition Is^ difficult to obtain, 
BOPERS uses an average distance of 1,SOO slles for plannlryg purposes. 
This factor is used here; ^ The mileage data Is ccsiblned with the cur- 
rent schedule of airline tariffs; ob^lned frees the Civil A^eronautics 
Boari Thus the one-way cost of a 1,500 aile trip. Including 

tax, is $137. The total travel expense which ,could be saved If the en- 
tire st^ent popjiation could be trained at reaote sites is S3, 374, 054 
per yea*-, ^ _^ 

If ODHISAT Is eisployed, there Is also a saving of 
$2.50 per calendar day of training for. incresental livirg expenses 
whigh ^uld not have to be spent at a training center , Thus the Incre- 
mental living costL saved for the entire student population is S862,920 
per year. 



- total gross travel and -living savings per year 

(TGS) for training at r^te sites, as cospared with CMI training at 
the training center, are 



TGS « $4,236,974 



c 

\ . 



^^ee Xppen^ix G. 
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or a present value over eight yeairs of 



'TGS^ ^ $23,714,343. 

"^he number of training center terminals needed 
would be reduced if scene students were trained at their work site. One 
training cerlter terminal is required for every 60 AC® students. Hence, 
there is a saving cf one training center terminal for each 60 AOB stu- 
dents reached through COKISAT. h purchase price of 514, 2S0 and a main- 
tenance cost of $14"^ per Donth would be saved by eliainatir^ a training 
center terminal, as "found in Table II-*7. As irrficated earlier, the 
p^jrchase option is the least expensive and is used to estimate the 

savings. - ' . 

# 

The COHISAT costs and savings for each category are 
utilized to detenaine a break-even site population.'*' The distribu- 
tion of stuudents over Kavy sites cannot be obta^f^>ed; hence, it is 
assjned to be identical to the enlisted san distribution (Reference ♦ 
7). A cc^parison of the break-even population for a category and each 
site population in that category determine which sites could be cost 
effectively, developed for COHISAT. Sites with populations greater than 
the break-even value qualify. 

c. Deteraination bf Courses Justified by COHISAT Savings 
The next step is to derive an estimate of the nmaber of 
feasible courses, assiraing the nunber of sites recains fixed at the 
level determined previously. To this end, the costs and savings due to 
COtflSAT are reexaisit^ed* 

" — 

See AppemJix E. - , 
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Since only the feasible courses fras the first 1?' 
courses can be economically developed for CHI • independently of COMISXT, 
•the development and coding, course maintenance, computer leasing costs 
and the student time and Uving savings for these courses ace not at- 
trit«^ed to COMISAT. However, the develc^ent of any courses beyond 
the iVtrt would not be feasible trithout COKISXT, for these courses are 
^ fuski^ied only by savings achieved at remote sites. For this reason, 
the developcsent, coding, course maintenance, computer leasing costsfi ' 
and student tiae and living 'savings due to the use of CMiS^ the 18th 
and higher courses sust be attributed to COHISAT. 

One analytical concern should be noted for considering 
costs and savings associated with the" l8th.- Nth cours^ As before, 
. all cost elesents are -considered over an eight year period. It is also 
important to note that the annualized values not only represent costs 
and savin^r^r the first eight years, but also" apply to a program con- 
tinuing beyond eight /ears. 

Once a course is formatted for Oil at reaote sites, it 
will also be used in this form at the training center to train studenti . 
whose base is .'not outfitted with a terminal. .Hence, OOMISXT must be 
charged for^t^ additional training center /terainals required to teach 
the course. The total cost to COHISAT is the sm ot the developeent 
and coding, course maintenance, computer le*#*^g, training center ter- 
minal, and COHISAT terminal costs, as susuurized in Table II-4. The 
savings credited to COMISAT include the travel- and living costs for all 
, courses, student time and incremental living savings for courses justi- 
fied only by remote site savings, and training' ,c^ter terminal savings 
for the first 17 cour8^i>- 

The net COMISAT ce»t expression which includes all of 
the above mentioned costs and savings iss 
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Ret C30KISAT cost « Developfte;^ and coding 

■^ Course m^inteniince 

^ Co«puter leasing [ for courses 

4^ Trainiivg center teminals > justified by 
^ COKISAT terainals ( COKISAT savings 

\ ' • - Travel ard living 

- Student tise 

- Increaental living 
+ COHISAT tensiinal. ) for courses jus- 

- Travel and living > tified by train- 

^ - Training center terainals ) ing center savings 

This expression can be reirritten so that the only unknown factor is the 
number of courses which should be developed. Maxiaizing the TOt cost 
expression yields the optisus nuisber of. courses for CHI develc^j^nt.^ 

d. Determination of ^ddit^onal COHISAT Sit^s 

With the nujsbsr of courses fixed at this new level, the 
feasible sites are again identified using a break-even population as 
previously described. The iteration between courses and sites is con- 
tinued until the net savings changes by less than 5 percejnt fros one 
_ cycle to the nextr The results obta^ed by this ^procedure are dis- 
cussed in Section B. 

D. Conclusion 
— i 

The analysis described here provides a ne^ssary first assessment 
of the economics of the COMISAT TOncept. The setbodology de^loped for 
the analysis can be used as the basis for acre detailed analysis in the 
future as the COMISAT concept and its potential applications becosae 
better defined, h major step in that definition is confirsation of the 
operational feasibility of the concept by dcskjnstration^ Most ispor- 
tant is the potential not only for savings in Havy training, but 
throughout the Department of Defense. - 



^ See appendix B» 
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Chapter ill ' 
RBSEARCB DESIGN 



r 

A,^ Intrcx3uction 



As indicated^ earlier, the COMSAT project has eight objectives: 

• To detersine whether CMT delivered to r»ote sites produces 
the sase leat'ning eff ecti^teness as Oa does in the leacnijw 
center enviroraent ' - 

4 To 3eter»ine whether the attitudes of students, trainers, and 
key remote site personnel are supj^ttive of CHI delivered to 

— '^^ -Ites 



ifeote sit< 
T^ deter^j 



Ine whether CMI delivered to reaote sites is as 
economical as (XL in the learning center envirorsient 

To detenaine ^the personnel requirements ^ 

• Tq determine the personnel training requireaents 

. • determine the organisation and manageaent structure re- 

quirements I 

• To determine ^ remote site space requirements and opera- 
tional procedures for effective use of a CHI training' support 
system ^ , 

— • To determine the equipment, maintenance, spare parts and 
logistics requirement rfi^ 

Achieving the first two objectives, concerned with learning effective- 

• s= * 

ness and the attitudes of students and key pitsonnel, requires the use 

of statiitfciOTl »etbods. For. the remaining six objectives, the thfor- 

■ation and data gathered during the deaonstration will be analyzed on a 
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case study basis. "The_ data related to the econooic analysis, for 'ex- 
ample, will be used. to check the assuaptions Bade in the preceding 
chapter on the^co^t effectiveness of an "operational COMSAT systea. 
The infonaation and data related to-personnel, »anageaent, proced-ures, 
and logifftics will represent only one of miny situations to be found at 
Navy .land bases and on ships. However, thfey can be used to infer 
c^>erational requireaents . ' 

The following two sections present descriptions of the' statistical 
.aethods to be used for a sse||arM learning effectiveness and attitudes. 
Succeeding sections address^|^a gathering and analysis to be used, 
for each of hhe six reaaining objectives^ • 




®- statistical Desi<yi of the As^sgent; of" Learni'ng-Ef fedtfvenesB 
!• General Statement o^^^ ^pj^earch HnAt^l ^ 
. ^- The general approac^^fthis objective is an experiaental/ " 

control group design Where the ^^arning" ef fectivertfss for -a CMI program 
in an operational tra^ng environaent will.be systematically coopared 
to learrning ef fe^^tWftlis in the training ienter^envfroraaent. The 
basic roeasute of effectiveness will be the time required to cooplet 
the CMI coursV. This aeasure 4s used because perfect 'scores are 
quired to pass from one aodule to another and ccxapUte the course. 
Differences in learning are reflected only by the difference in the 
time it talMe students to finish. 
♦ ■ 

A second concern with regard to learning effectiveness is 
whether or not. students taking the OCI coorse at the operational site 
learn raore about electricity and ^ectronics than studehts taking the 
existing BB/E correspondence cx>urse. To find out, volunteers froja the 
outlying Stocjjton sites will be given the correspondence course. A 
specia; exaa ^11 then be prepai^ by PRC test the basic kpowledge 
of electric! t>' and electronics of the students ccwpleting the CMI 
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course ara those -conpleting the corre8poV>denc« course. As a check on 
the validity of. the special exaMr it will also be given to B4 to E6 RMs 
ttith-no foraal trainj^. If' the teat is' conceptually valid, both the 
CWI and correspondence groups should score higher than those with no . 
formal training. ' "4 • ^ _ 

An ideal experisental design addressing these issues would 
. randcxBly assign subjects to bhe experiaental and Control groups froB, 
respectively, pers<5nnel, per foraing .operational^ duties at Stockton a,nd 
.trainees at a training center. This^is not obssible at the operational 
* site because: ^ ' / y * 

. • # The program has to be vpluntary ^'^^ 

• Only KMfi are available to participate 

^ ' ^ The humbe.r of volunteers is small so ,that aU have to be in- 
cluded in the experiment to aee^ paraeetric statistical 
assumptions ; / - ' . ' ' 

The fact that- the- experinrental- group will coteist of volunteer enli*ted 
RMs ranging froa the Ei to B6 paygrades QoespUcates the problea of se- 
• ■ lecting a control group. , Since RMs ^a re not required. to take -the BE/E 

course, none, or at »ost pne or two, can be^ e^xpected to be taking it at 
the tiae of the deaonstration. Pew are even *ixpected to be found In 
histori/:al records of the BE/E course. Therefore, _ i^ is necessary to 
select a basis for coaparison other than. the saae rating. 

^ t ' It was decided that the basis for dbt^iaifng colorable con- 
trp; groups would have ^o be the paygrade level ratlwbahan^e PM rat- 
ing. Here it was reasoned that the next best thing to having a control ' 
group, of th^aae rating would be to havej||^ control group eonslst of 
personnel with roughly equivalent experience. The basis fo/ tKls se-. 
^ lection is that aotivation and' ability are highly correlated with ex- 
/ perience. This st!fe.l does not peralt usingv^urrent trainees at 

v. ^ • ■■ , T ■ ■ 
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schoolhouse, because BE/E is an A-School course with few trainees 
of the higher paygrade levels. However, there are expected to be 
enough historical records of" trainees at the E4 to B6 level to obtain a 
control group. 

The experimental design for assess ijig learning effectiveness 
will therefore cxepare the tiae to coeplete the CKI course by RHs at ^ 
Stockton to the perforaance of trainees irlTh similar paygrades in tiie 
historical records of the CM course at a training center. In addP^ 
^tion^ the perforaance of CXI graduates free Stockton «i/a general elec- 
tricity and electronics exaa will be compared t^fce ^rfonlanc* of 
Stockton personnel who cceplete the coxrespond^^ course. The design 
is shown m Figure III-l. 



2. Research Hypotheses ^ ^ 

Froia the first objective it is hypothesized that: 

The total training hours required f or *exper iaent\^ sybjects 
to complete the BE/E CMI course requir«aents will be less 
than or equal to the training hours required for training 
center subjects to complete BE/E course requireaents. 

statistically it is necelsary to test this hypothesis by 
_fw:st deteroining if the^ following null hypothesis, H^, can be 
rejected and one of the alternatives, or Hj, accepted. 



> 

where a * the aean tiae to completion of the experiaental group and 
is the aean tiae to cospletiorj of the control groui^.- If is re- 
jectedr then, the value of the aeans will deteraine'if or H2 is 
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to be ^epted. Should be rejected, the probability of H. 

being fidse will be deterained* 

It is also hypothesized that: 

The CHI BE/E training qto^sp will p>erfor» better 6n a special 
electricity and electronics examination than will the corres- 
pondence training group. 

Stated sys±>olically: 

^o • ^ - - 

I a > b 

The null hypdthesi^, H^, assoses no effects due to dif- 
ferences in training setbods, and the alternative hypothesis, H. ^ 
predicts that the score, , of the CHI BE/E groq? will be higher on a. 
special electricity and electronics exan than the scores, i , of the 
correspondence group* 



As a check on the validity of the special exas, the scores of 
the Oil and correspondence groups will be coepared to those of a group 
of E4 to E6 RHs with no formal BE/E training. Porsally stated, it is 

hypothesized that: 

Both the CHI and correspondefice course graduates will achieve 
higher scores on the special electricity and electronics exas 
than the personnel with no formal BE/B training. 

The symbolic representation is: 



o • - • - « - 



^1 : - > c? 



46 ." 



59 



i 



' . TAEG Report Ho, 49 

The null hypothesis assists that r>either of the two trainir^g 
programs has afi effect. The alternative hypotheses H^^ ^ g 
predict that the scores a and i of the CHI arri cor respor^ence groins 
will be greater than the scores - of tne group with -no formal train- 
i'^. If H,^ or is not confirmed, further stiidy would be required 
to deteraioe if no learning occurred doe Jto OQ pr corresporvdence^ or 
if the exaji itself was poorly designed, 

3. Definition of Research Variables ^ 

i^ependent variables are the location of the trainiryg 
and the sethod of training. The location of traini?>g is the more 
isportant concern, since aetersinir>g the differervces in learnir^ 
effectlvenress, if any, between the CKI course at ^ rWte site «rrf at 
a training center is the aajor abjective of the (XmzSkT project. The 
aet»^ods of training investigated m this project axe the, CKI apd cor- 
respor^ence •ooursesf, 

<^ependent variable for detersini^^ the effect of location 
on CMI performance is the total asount of ti:se required to re^h 
criterion on htodules 1-14 of the BE/E oourse. This ifKrljdes all of tne 
st^ents* ti^ spe^nt st^^ying, doif>g laboratory experiJients, ar^ taking 
performance and icnowledge tests for each laodule. The variable is ex- 
pressed m total Sours spent for the courseT 

^ependfint variable f or 'detersinlng the differer^e in ef- 
fectiveness between CMI and the c»rrespor>der>oe course training methods 
is the score a specially desigi^ teat wtiich measures krwwledge of 
electricity and electrofrics materials -cqiftairked in both the Oil BE/2 
course fReference 10); and the correspondence coar«e «4nual. Chapters 
1-15 (Reference llK The test will draw fras Baterial_cois6on to both 
the Otl^and oorresjxixvaence aateriais. 
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Tbt oovarlate or interv^ing v&riftblM are used to adjttstr^the 
values of the dependent variables to accotmt for Initial differences 
beti^een the people vhose performaj>oe is being ^easared. For exm^i^, 
the Oil stodents at Stockton aight have consistently different Ea^ic 
Test Battery CBT3) scores than the training center c<«^trol group. The 
BTB IS giver, to each enlistee, and ^s a standard Havy aptitude »easare 
used in part in assigning enlistees to ratings. If the BTBs are dif- 
ferent, then a difference in CHI performar^e can be expected. The 
covariarK^e analysis statistically batches grcKij« so that the differ- 
ences dje to location, of tJ^e training can be assess^, 

The BTB scores wi^be used as the covailate in cellaring 

learni'>5 effectiveness the site to that at the training center. The 

* 

scopes have been shew* to be negatively correlated with the seasure of 
per for^a.-vce m the course; i.e*, people with higher BTB scores taice 
less tLre to coeplete-^e coarse. Because of significant ^rrelatiofis, 
BTB scores are presently used as^the basis for E^edicti?>g the ccsple- 
ti-:^. tise for each CKI st^ent. The predictior^ are ased by the LS in 
?5onitori"#9 st^ent progress* 

Both BTB and di2^r>ostiC reading scores will fc>e used as oovar- 
lates m cocparing st^nt performarK^ on Oa to cx>rrespondence strident 
perfcrsarice, Again, previ<^s evidence shows a correlatic^ tetween this 
ability arid success in training* This correlation was particularly 
^^gnificant ir electricity and electronics training. 

V * 4. Statistical yk>dels . ^ • 

One-way analysis of covariance statistics will be used to 
test these hypotheses* Syr^bolically, the i^el is as follows: 



A {i«l/2,,..,a 



4j - ^ 



l/2/« .t^n 
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the jth observation on the dependent seasure, e.g., 
.total tiee to cosplete BE/B -course, under the itS^treat^ 
»ent, e.g., exi>eriBental or control site; 

the covariate variable(s), e.g., Basic Test Battery 
. score, corresponding to y^^, 

the 2ean of x^^ scores; 

the overall sean; 

the effect of the ith treatment; 

a linear regression coefficient showing dependency- of 
y . , on X . ^ ; 

the randos error component ; 
The sodel assj^es that; 

Errors ^^^e norsal and independently distributed^ 

5 « 0 and tne relationship between y^^ x- is * 
linear , '3 , ^ 

Regression coefficients for treatments are identical 

TreatBent effects sdsk to zero 

The covariate is not affected by the treatment 



le ? statistic IS os^ to test H 

o * 



(SSV ^ SS£)/(a - 1) 
SSp/ a(n-l) - 1 



4* 



ss 



2 * error sisi of squares? 

^^*2 ■ reduced sua of squares for error; 

E " " the reducticffi in suas of squares in order 

to test the hypothesis of to treertsent 
effects; 

■ the number of treatsent {exper iisental) groups; 
n " the nusbe^^f subjects p«r group. 
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The noil hypothesis will be rejected if* F^>f^ ^ 

The alpha ievel or level of confidence for statistical 'tests is set at 
p < .05. ' J 



It should be noted that for the second hypothesis, i^e,, de- 
tersining the effects of CKI and correspondence training aeth^s oh 
learnir^ electricity ar^l electronics aaterial, it aay not be possible 
to jse the covar lance analysis because of the saall nuaber of partici- 
pants anticipated^ in the correspondence course, 'should the saxpi)? sire 
fall below 20, it say be necessary to use an equivalent nonparasetric 
statistic. The appropriate ccdel for this situation is the Kruskal- * 
Hallis one-way analysis of variance by ranks statistic. Stated / 
syr^bolically: ^ /' 



N'^N * 1; 



S h 



3(N * 1, 



wh<?re it ■ nuitber of samples 

n^ s nui^ er of cases in jth sa^le 

^' ~ ^ the ntiaber of cases in all saj^les cOE^ined 

» sus of ranks in jth sac^le (colon) * 

The H statistic' is used to test the hypothesis and, with a sasple 
greater than five, is distributed approximately as chi square with 
k - 1 degrees of freedcc, 

< 

5. Data Collection^ Organization and AMlysis 
a. Input • 

At the oDnclusion of the demonstration all data will be 
transferred free data tally sheets to pulxrhed cards for the arialysis* 
Appendix H contains a saaple data tally sheet «uy5 shows the <Jata format 
for the punched cards. 
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The BT3 data will be recorded on data tally sheets by 
PRC staff with the assistance of the ESO during the week of September 
12. The reading ability scores will be recorded on tally sheets by 
October 21. The last data input will be the CHI course performance^ 
correspondence course p>er f orsance, and perforaance on the elect^ricity 
and electronics special exanf. These will have been collected by Karch 

4 

10, 1<378. • i * 

* 

An added requirement for the Kruskal-^Wallis analysis is 
that the^ data sjst^be arranged as n cases of two variables, wherein is 
the njnber of subjects , One variable is the test score; the other is ^ 
an identifier which indicates whether the subject is in the CHl/^ 
correspondence, or no-foretal-tra ining group. The injHJt forisat for 
these data is also shovn in the sasple punched card in Appendix H, 

b. Co^utational Steps 

The conq^utational steps for the oovariance analysis are 
qjlte lengtfhy. The .reader can find a discussion of the procedures for 
one-way analysis of covsriarrce in Reference 12. For the Kruskal-Wallis 
analysis coopjtatlon the procedure is far les? costplicated. The reader 
is again referred to Reference 12 for the specific computational 
procedures. • ' 

c. Output and Interpretation of Results^ — - - 

The computer output for the covariance analysis includes 
a nunber of Important itess. These are: 

# Regression coefficients, their standard errors and t vdlues 

, ♦ Group aeans, adjusted group ^ans, and standard errors of ad- 
justed group means 

♦ Analysis of variance table with P test for equality of adjus- 
ted groi^ means, xero slojie, equality of slope, and the tall # 
area probability 

• « 
* 51 . ' ■ 
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m Pair wise t test for adjusted group means and t test for con- 
trasts of adjusted grou^ ®eans 

• Regression coefficients for eadi covariate in each group 

Proper interpretation of these results requires that a 
seqj^nce of steps be followed: 

• The regression coefficients should be the sa»€ for treatments 
^ in each of the 04I, correspondence, and, where appropriate, 

no-formal-training groups. If they are not, the relationship 
between the selected covariate and the dependent variable is 
different for each group bet^^g neasured. Another covariate 
would have to be found which does not have a different rela- 
tionship for each group, data obtained for the new covariate, 
and the analysis repeated until satisfactory covariate ii 
identified, , ^ 
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W^^" equality of sVopes should be checked to 

cof.firs that the regresjsion Ij^s for the three groups have 

'■the-sase slope. If the^lopei are significantly different, 
the covariance analysis is not appropriate and analysis of 

- variance would be substituted. 

For the first hypothesis concerning course performance the P 
test for the equality cf adjusted group Rvean is the Bost ij&- 
portant result frocs the output. Provided the previous as- 
sucrptions have been set, a significant ? ratio will indicate 
that the two training environnents produced course perfor- 
mance resjlts that were significantly different froa each 
other. The more effective training envirorcsent will have a 
lower adjusted group mean ir^dicating less time required to 
reach criterion. 

If covariance is used to determine the effects of different 
training sethods, then a significant ? ratio would require 
checking -t ratios since there would be three, rather than 
two, groups involved. Checking the t ratios becoees neces- 
sary in this case because a significant F ratio does r>ot in- 
dicate which group seans are significantly different froe 
each other, it only indicates that there is a difference. 
The t test will show the ordering of the three training 
aetbods in teres of test performance and the level of signif- 
icance. The level of significance of the difference in per- 
foraance between the CMI and correspondence groups should 
also be assessed by conducting an P test of these two groups 
without considering the control group. 
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The output for the Kruskal-Wallis test statistic is less 
coeplicated ai^J include^' the items listed l^lowj 

• Test statisti^ H 

• Level of significance* or probability of occurrence 

Saisples of the printout for each 'of these analyses are 
provided in Reference 12. , ^ . , , < 

' If the KrusXal-Wallis analysis is used for the second 
hypothesis test of the relative effectiveness of training Bethods, the 
H statistic is interpreted in the sase aanj)^ as the P statistic but by 
using the chi square distribution rather than\he P diseriBution. A 
significant B will be interpreted as confireation of the alternative 
hypothesis, i.e., that CM is better than correspondence or no foreal 
training, if the^ groi^) ©ean differences are in the predicted direc- 
tion. A significant H test with the 'no formal training* group in the 
analysis would lead to a recoesendation that additional analysis be 
con^ucfed without the control group. This analysis would provide a di- 
rect assessment r^ative to a treatment effect due to CMI training ver- 
sus correspondence training. 

Definitions and Procedures for the Attitude Objective 

!• General Statement of' the Research Model 

Por this objective attitude measures will be coispared between 
operational site students and a comparable grouJ> of individuals taking 
a CMI course at training center facilities. A cos$>arison of attitudes 
will also be made between the LS at the site and LSs at the training 
centers. A third concern is to assess the attitudes pf key Stockton 
operational personnil towards CM, ' , 

I 

S»antic diSjferential scales have been designed to eeasure 
attitudes toward a nuaber of Oa dinensions. These include Ott as a 
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concept,. eourse^ferial, the LS as viewed by the students, the stu- ' 
dents as viewed by the LSv testing procedures, and test feedback in 
teres of content and response tlBe. A pretest-posttest approach will 
be followed in collecting the data. 

SUtistical methods Mn be used in coeparing experimental and. 
control student; groups. Por the LS and key personnel at Stockton, how- 
ever, cooparative analysis of attitudes/ will not be possible, m the - 
case of the LS, it will be possible to test several LSs at the training 
center. This information can only be used as a guide in searchin^r 
conditions at Stockton that strongly affect the LS's attitudes towards 
the delivery of Oil at a reiote site. Ko cceparison will be pdfesible 
for the attitudes of key Stockton personnel. However, the attitude 
test results will be useful in determining the conditions cost affect- 
ing their attitudes. 

The following subsections describe the analysis of student 
W attitude data. The final subsection briefly discusses criteria for as- 
sessing LS and key personnel attitudes. 

a. ^ Deconstration Groups 

The experieental student group for^the at^tude« study 
will be the on students at Stockton. Since the control group for the 
learning effectiveness analysis is drawn free historical records, it 
cannot be used in the attitude study. A separate control group is 
needed , 

The objective is to detereine attitudes' toward OtI as a 
delivery systea rather than the specific course." Therefore, although 
it is possible to find subjects in any 0!I course at any' training cen- 
ter, the i£?>ortant factor is that they be similar to the expe'rlaental 
subjects with respect to length and level of service experience. That 
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is best represented by pay grade. The reasoning behind this choice is . 
that people with the same length of service. experience would be more 
likely to fiave similar aotivat^ion ar4 reactions to learning conditions. 

In order to adjust for differences not eliainated by the . 
^ use of equivalent pay grade| in the control group, covariance analysis 
will be used in evaluating attitudes. Based on previous research with " 
semantic differential instruoents, pretest measures have been shown to 
be a good ©eans of adjusting posttest aeasures to account for initial 
differences between the experiaental and control groups (Reference 13). 

Although any training center Is a candidate for provi- 
ding attitude control groups, it is expected that Kesphis will be the 
choice. The only factor that can change this is the possibllfty that 
not enough students at the required pay grades will be found at the one 
school . 

b/ Validation Groups 

Prior to demonstration data collection, a conpeptual and 
statistical validation of the student attitude Iqstruaent is neces- 
sary. A sanple of at least 110 subjects will be needed. The BE/E 
schools at Great Lakes and Memphis appear to have the eost repr-ft^n- 
tative saraple of BE/E QU students and will therefore be used for tSe 
validation study. 

\he validation study will use factor analysis to reduce 
the jiuffiber of variables 'used in testing attitudes toward each CHI coa- 
ponent. The resu^lting version of the test will be ©ore a<xrurate and 
conceptually valid. Figure III-2 shews the design approach, including 
validation, for the attitude objective. 

2, Research Hypothesis 

It is hypothesized that: 
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/^/£?(//^ /// 2 'Research Design F6r CMl Attrtude Anafyses 



Attitudes toward CJtl cpjicepts for ke/, site personnel and 
tr^Jnees as aeasured bji^eaantic dif f'erential scores will be 
equal tc or oore sUKxsrtive than ^^*tritudes of trainees. 

Stated sysbolically: 




: a < ^ , 



wh6re the null hypothes^, H^, ass^s no attitude effect" Sue to the 
different training sites, and the alternative i hypothesis, Hj^, pre- . 
diets that training in the operational context ^rill produce attltudefe 
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toward the CMI c6hcept ©ore supportive , than at the ^radi tional training 
center, if H^. rejected; the mean scores wi;i be examined to de^---^ 
termine if training at the operational site is aore desirable than ^t 
the schoolhouse or vice ve'r^a. 




3. Definition of V a^fcles 
The training site is the swrjoc independent variable for atti- 
tude aeasures. The experimental site ha^ already been defined as the 
operational training site"at NAVCOH?^A Stockton, The control site{s) 
wil^ be one or more' training center facilities with CHI. 

• <3ependent variables will be attitudes toward the CMI com- 

ponents addressed by the saiantic differential scales, Tbe semantic 
differentials were developed j^^^h bipolar adjectives consider^ rele- 
vant to that concept. As an exasplei the bipolar , ad jectives considered 
relevant to the CMI concept are shown in Figure III-3. The cocapiete 
insferuaient addressing this and the other c<:^tponents is presented in 
.Appendix I, 

\ 

As indicated earlier, pretest attitodfe scores will serve as 
the coyar late for each an^^sis. 

4. InstruT^ent Validation . 

^ As indicated above, the statistical validation of the atti- • 
tude instruaent requires appropriate factor analytic techniques. The 
basic statistical sodel for this validation stated symbolically is? 

% _ 

^^^^ 2j - variable j in standardized fona, deacribed 

linearly in terss of and 
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, bad ^ 
organized 
approve 
useful 



Figure 111-3 Semsnvc Offierenttaf Instrument CMt Concefit 



« new uncorr-elated coaponents 
^ « standardized regression coefficients 

«» 

Factor analysis is used to insure aeasuresaent reliability and 
conceptual validity by removing unnecessary seasuressent overlap. Bs- 
sentially, the procedure will allow us to deteraine which adj^tives in 

" the seaantic differentials are intercor related. The aajor objective of 
the' analysis is to arrive at simplified subjective aeasures for each of 
the concepts in the study. ^ in the present case/these measures derive 
frocB a subject's response to the seaantic differential instriaent (seje 

'Figure III-3). The result of the factor analysis is a staller niaber 
of bijwlar adjectives being abstracted ftoa the larger instruient. The 
adjectives which are abstracted froa the larger set represent the varl- 
ous ways that respondents interpret each concept. In response to the 
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survey, .those adjectives which are correlated with each othex^ are 
used in a siailiar fashion by subjects are said to repr^^^nt^'J*^^^^^ • 
A factor is a theoretical construct which is assisted to charajjb^-z^ 
one dimension of a survey or test. In education, for exas?5le^^erbal 
ability is thought to be one of several factors underlying intelligence. 

As shown in Figure III-4, the data indicate that one of the 
factors underlyirvg the Oil concept has five bipolar adjective sea- ' 
sures. These adjectives all have relatively high factor ItJadings 
^between .69 and .84) under Factor I and relatively low loadings under 
each of the other factors in the matrix. All five adjectives would 
serve as a valid reasure of Factor I. Since these adjectives represent 
attitudes as opposed to othec factors in the ^ati^ixr Factor I has been 
labeled "attitude/* Theoretically, scores fross any one of the five ' 
could serve as the attitude measure. However, greater seasur^ent re- 
liability is obtained by s=JEsing scores frosi all five adjectives. 
Based on adjectives with high factor loadings,- our hypothetical example 
yields^hree other factors which we have arbitrarily labeled: 
■adequacy of the systes,' Factor II; "systes^eeaningf ulness , " Factor* 
III; and "system appeal .Factor IV. Sirfce our primary interest in 
this study is the seasur^ent of attitudes toward the CHI concept as 
included m Factor I, only those five adjectives would be used in the 

^ analysis. The revised version of the CKI concept test based on the 

J factor loadiT>gs is shown in Figure III-5. 

For the pilot validation the principle factors technique fol- 
lowed by an orthogonal rotation to sieple structure with the varlesax 
criteriOT i/lll be used. An eigenvalue of 1*0 or greater will be used 
as triterlon for ^terminating factor extraction in the rotation proce- 
dure {see Reference 14). In the present case7 the factor analysii^is 
performed on the nf x n correlation matrix^ fonsed fro« each set of se- 
santlc differential scales. Essentially/ the factor analysis identl- 
fles clusters of adjectives fro* the correlatlpn matrix *^ich are 
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intercorrelated and bear a relation to or>e or »ore factors. This 
^analysis results in. a factor satr ix .containir>g factor loadir>gs. Factor 
loadings are basically an ifvdication of tbe degree of relation between 
a bipoLar adjective n^easur-e and the factors. Froa the xaw factor Ea- 
trix an orthogonal rotation is performed so that the clusters of adjec- 
tives can be arbitrarily placed in the a:>st sea.ning£ul psychological 
array. This rotatic^ yields the factor aatrix depicted in Figure 
III-4, In this exarrple the eignevalje critericm reduced the nusber of 
fseaninpgfjl factors m the rotated matrix to four. Other factors are 
dropped" frocs the matrix because they iccoont for virtually r»ne of the 
variance in the survey* 

The criter;cm for acceptance of an ^ tea :r. the fac^r strjc- 
tjre will t^e set at a -factor loading of .6-0 or better on o^e factor ^tA 
.30 or less on any other factor in the ;£atrix. While vot anticipated, 
soce salification of this criterion say be necessary depervdiwg on the 
ojtcoce of the jrotated factor satrix. fSoce researchers use less 
stringent criteria for placing a scale into a *given factor in the ma- 
trix, such as ,50 and .40 x^ste^ of .60 and .30 reepectiveiy . 1 

Once the instru^rent has been vali«|ated, a one-vay analysis of 
cova nance will be '-used for the deaonstration data. The covariarvce^ 
model for the attitude analysis'. is tJ^ saae as that for the <»urse per- 
fonaance analyses. * 

RefereDces 14 and 15 are reccssaend'ed for an in-dapth discus- 
sion of factor analysis theory and applicaCion. 



^. Dat^ Colle<*tion^ Organirationy and Analysis of Student 
Attitudes . 

a. Xnp<gt 

At the conclusion of the deaonstration all data will be 
transferred froi.the data tally sheets to punched cards for analysis as 
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shown in KppenAix H, Pretei^t .attitude data at experlaental and cx>ntrol 
sites will be <x>llected and tabulated by ??c staff with the assistance 
of th€ ESQ dgrir>g the week of August 18, In the case of the control 
subjects, pretest data collection aay be at sore than Of>e s'Me as de- 
signated. This data collection will be done by PRC sUff with assis- 
tarK^e free designated personnel at the control group sites, Posttest 
attxt^s will be collected and tabulated by PPC sUff with assistance 
fr^ the ?S0 and designated assistetnts at the copclusion of each 
student's course. It is esti^ted that the last student will finish 
during the last week of February. 

b. Coeputatlons arni Results 

The TOvarxance analysis will be slsilar in fors to that 
described foc-'*^fe-<iat ion of course performance data, h nonsignificant 
? ratio, or a significant F ratio in favor of experimental grc'^ atti- 
tudes, will confirs the hypothesisr \hat student attitudes at the resote 
site are siirpportive of CM. 

^* LS and Key Personnel Attitudes 
' ' The student-validated Instrisent will be used to assess the 
attitudes of the LS and key Stockton personrvel. Xs indicated earlier, 
the LS's attitudes towards (XL delivery at res&ote sites will be cce- 
pared to the attitudes of LSs at the training centers. The LSs of the 
control group students will be given the pretest-p>ostte8^ combination. 
This will probably involve no aore than six to 10 subjects. 

1^ attitudes expressed by the Stocktcm LS will be coepared 
to the «an scores of the training center l^s, Areas of differences 
will h^ explored to find out what cxxxSiticm »ost affect the LS*8' atti- 
tude. This information will be suppleaented by inUrview data obtained 
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in sjpport of the personnel, personnel training, facilities, proce- 
dures, arid logistics objectives of the deconstration. The interviews 
axe descri^e<i £n later sections of this chapter. 

Key personnel attitjdes will also have to be exaained for in- 
dications of Mjor cc^vcerns. In this case there will De r#o comparative 
inforratio^to' guide the assesssent ^as there is with the LS*^ . The re- 
lative ceas^rfes froc the tests, and the change in those aeasures, will 
provide jsef j1 :nf orEatlcn* Additional understanding of areas of sa- 
tisfaction and dissatisfaction will be obtained froa the , interview res- 
p^-^ses gathered for the other objectives. 

For both the LS at Stockton a/>d the key Stoc'tton personnel, a 
score of 4. CO or higher on any aspect of the^^QG systes viil be re- 
garded as favorable- since it is above the hy-pothet ical ^ea^n. That 
finding wpould confirs the h'/Tpothesis that key per5g:>|^ will be sup- 
portive of CKI deliverjrd to rezote sites. In a<^Ui|{p^ the assesE^nt 
of &a:or factors influencing attitudes can lead to recossendat ions' for 
an Improved delivery system design. 

'D. Bconotiic Evaluation 

1 • Data Gathering Objectives 

The purp:>se of the economic evaluation is to obtain improved 
estiBates on operational costs for the Ct^dSAT concept. Those esti- 
mates would persit updating the analysis of Qhh^^t^t ii to obtain a aore 
accurate projection of net savings to the Ifavy attainable through a 
fully operational r^te-site Oq network. The specific data gathering 
objectives of this evaluation are as follows.- 

• To determine all costs of procuring, installing, saintalning/ 
and operating the cowsunlcation systes required for the Oa 
dcaonstration. This will require data on th^eMablli ty and 
Ealntenance of the terminals, particularly tbt- Opscan, and on 
the reliability of the coeBunicatiOT link. 
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To deteraine the eqtiipoent and Baterials (including 
expendables) required to. keep .the CKI course in operaticMi. 

To determine the asount of additional personnel hours ex- 
perked on activities connected with the CXI d«onstration oi>- 
jectiv^s by: . . , ' 

— Bach student 
~ The LS ' 

The ^Ts ' 

— watch si^rvisors 
The SSO 

— Division Training Chiefs/Petty Officers CDTC/POs) 

— Divisi<X5 Officers 

Co^onications Officer^" 

— CXI advisor /""^ 
Other staff 

_r 

To d^teriine the equivalent oMts of c^rating^ tne corre§- 
por>dence course: 

Stodent hours required 

Cc^t of materials 

— Cost of saiL 

~ Remote site personnel hours required 



Tjsis inforiMtion, along with the asses^ent of correspondence 
course^ effectiveness, vill be used to coepare CXI and- cor respor>dence as 
a seans of reducing Navy training co^ts. 



2. Data Gathering Procedures 

a» Cgisuni cation System Cost 
; ^ \ 

At the end of the demonstration", JCISA K^his will pro- 
vide PRp with a complete cos^breakdown of the CTemunication systcs. 
The required data are as follows: 

• Lease, including installation and maintenance, of two ' 
Ops<^n/TerBinet clusters * 

• Lease /^lrx:luding installation and maintenance, of a cod^r- 
cial dedicated line froe Stockton- to San DiegO/ including a 
Bell 202-^ modes at each end of the line 
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• Lease, inclodip^g installation and maintenartce, of an RP63S2 
asynchronous line ©odulator to connect the phone line to the 
CKI concentrator at San Diego 

These data will be collected and aailed'to PRC tn 
HcLean, arriving by March 10, 1978. 

j| As part of the assesszsert of coraunication systejs costs, 

-th^ data collection systes will seasure the syste«*s reliability and 
samtena^e requireeents in the following way: 

• Vfhen either the Op^^^an or Tersinet mI functions, the LS or BT 
enters into the E^'intenance log ^see hppen6ix J): 

— Identification of the eguipcent- 

— The tii^e at which the failure was first noticed 

— The tire the contractor is called 

~ The nature of t)^ malfunction • * - - 

On arrival, the maintenance technician enters the tise. When 
the work_ is complete an<Sl the equipssent back in operation the 
tii^ is entered in the log and the nature of the problei and 
the correction ^re described. 

• Dovn tise resulting fro^ probl^s with the co«unication 
link, -the-oa concentrator in San Diego, or the CKI-oo^uter 
in Henphis, will be recorded by the LS or ET. If not ixsedi- 
jstely known, the LS or grr will ^determine the cause by con- 
tacting MIISA San Diego or .H^his and recording it in the 
sainteriance log. ' ^ . ' 



On the first 4ay of each ©onth the LS will send a copy 
of the Etaintenance log to PRC in McLean, Virginia, 



b. Personnel Resources 

(1) Student Course Tise 

Each student in both the (XT course as^'well as the 
correspondence course will be Issued a time card as shown in A'F$>endix 
J. h co^lete chronological history of ti»e spent in study (on and off 
watcfi), lab, "performance test, and knowledge best will be kept,- The 
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Oil students will have their ti»e stored in the cctiputer* For thea the 
card is a reference f ro« which corrections can be sade if there are er- 
rors in the cocsputer entries. The LS will sake any corrections that 
are neede<^. Pinal data on the totad course tijike will be provided to 
F!^ by MIISA by February 28 , 

I 

(2) LS Ttge. 

TiKe spent by the LS and the type of activity will ' 
be recorded in the log described in AppendiJf J. The data to be re- 
corded each day are: 

• Date 

• Hours devoted to counseling the students on course content 
problems 

• Bours devoted to administrative functions, e.g., eaintaining 
student files, Aswering procedural questions^ and <5copdi- 
nating activities with Fleet Center operations 

(3) ET TiB>e . . - 

Vfhen the ETs act as resource persons in the^absence 
of the LS, their ti»e is to be kept on a log identical to the LS fore. 
The entries would be Bade in the Substantive Activities section. Ad- 
ministrative activities will be entered separately. 

* 

The ET lab equipsent eaintenance tiee will be re- 
corded in the ease Banner that the log is kept for Opscan/Tereinet 
Baintenancer . - ^ ^ 



(4) other Personnel 

ESO, Co«Biunicat ions* Officer, Divisi<Mi Offi'cers, 
DTC/POs and (JH advisor will eaph maintain a key personnel log. Hhen 
staff of the Fleet Center perfora duties on the de?ionstration, the Di- 
v^ision Officers will irOi^t^ Ui t^ir logs the type and duration of 

* « 
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the activity, arv3 the position of the person doing it. If indivi- 
dual not assigned a log is found to contribute a significant asount of 
tise to the demonstration, that person will be assigned. a log of his or 
her own* 

c. Equipe^nt and Materials * 

The concern here is to determine the asount and cost of 
lab equipment ^ aicrofiche readers, microfiche test cards, texts, answer 
sheets, a<^inistrative foras (PI, P2, P3), Tenainet paper, and expend- 
ables required per st^jdent. The BE/E Training Prograia Coordinator 
^TPC^ at CKTECHTKA will provide PRC at HcLeOT With an it^ized cost of ^ 
each shipment. 

It will be important to know if the shipcsents adequately ^ 
sjpport the operation. Therefore, the LS and BTs will note in their 
logs any instances where equipcaent or sateriala 5re not available to a 



d. Correspondence Course Costs - 

The following data gathe&ing will take place during the 

deiBonstration: 

« 

• The correspondence course student tise data will be maintain- 
ed by the.SSO at Stockton. Each Friday eac^ student is to 
give his or her weekly card to the DTC/PO to be sent by Navy 
©ail back to the ESO at headquarters. Once a w^k, the ^ 
will send a sismary of student progress to PRC at McLean and 
^ive a copy to PRC staff on site, if amy, showing 

— Each student* s na»e 

— Lessons coepleted 1 
~ Lesson being worked 

— Total tiae in the course to date 
The format is shown in Appendix J. 

* The KO's tiae spent 6n cotrespdndence will be record^ sepa- 
rately in his log. 
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• The DTC/POs at the outlying sites will aaintain a key person- 
nel log, entering their tiae under the Adainistrati\re Activ- 
ity heading. The ESO is to receive the logs by base Mil 
each Monday, and copies are to be sent to PRC at McLean along 
with the CMI personnel logs, * 

• Estimates wil% be sought, based on correspondence, raurse ex- 
perience, for the cost of texts, tests, answer sheets, and 
aailing materials back and forth bet%#een the site and the 
correspondence center, Tf^ estiaates will be obtained frotr 
the Kaval Education and Training Prograa Develc^:»ent Center, 

f ' Pensacola, Florida, 



3* * Analysis and Results 

The data obtained for the econoaic evaluation will be used in 
recalculating the cost iis^jact of the CJOHISAT project with the procedure 
described in Chapter II, The cofsaunicat ion line and codes costs for 
the cossmercial leased lincf will serve only as a guide to cost and reli- 
ability problesas,"^ If ODMISAT goes operational it will use AOIOTIN II 
and therefore would not incur coi^erci^ s^ea equipment and leased 
line oost$. All the other* data on terminals, equipment, materials, and 
personnel will be u^^ to determine potential costs and savings of an 
operational system. \ ' , - ' . 



E, Personnel Requireaents 

.This objective is concerned with determining the tasks that have 
to be performed by onsite personnel and the level of effort required in 
order to support an effective CHI prograa. The personnel of Interest 
are the LS, ETs, DTC/POs, ESO^ Division Officers, and the Cooeauni- 
cations Officer, * 



The information ar«J data needed to achieve this objective oome 
froa three sources; 

• PRC staff will observe operations continuously over the firnjS^ 
^ b*o weeks of the de»onstra.tion, and then for one week inter- 
vals at the beginning of the second aonth of tt>e demonstra- 
tion, and once a month thereafter % 
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II 

# PRC staff 'will interview students emd key personnel at the 
end of the first two weeks, the end, ot the* firsts ioonth# and 
then once a aonth until the end of the deaonstration. The 
interview instruaent described in Appendix K will be used, 

• Key personnel tise logs will be reviewed each week as they 
are received by PRC froia the BSO. 

Based or> this information, recocsaendations for changes will be de- 
veloped as j^eded, impleaented after approval by the Casiunications Of- 
ficer or Division Officer, and aonitored, At the epd of the deaonstra- 
tion/ guidelines will be prepared for the nuaber ai^d tyE>e of personnel 
assigned to an operational CMI systesa and their tasks. 



F,^- Personnel Training Requirements 

This objective is concerned with determining the training needed 
for site staff 'supporting CHI courses. An assessment will be made of 
the tiae and activities in the demonstration that sight appropriately 
be classified as training for the sup^rting personnel. This will 
include the preparation of the LS and the tioe spent by the CMI advisor 
in dealing with sujJport jJer^nnel. Inadequacies and eff^tive elements 
of the training will both be identified, recoisaendations made for 
training to support an c^rational CHI syst«a. 

The demonstration has been set up so that the LS will receive BE/E 
Instructor training, and the and CHI advisor will trai-n the watch 
supei^visors and ETs tx> carry out their responsibilities* Time spent by 
the and CHI advisor with the watch supervisors and gps will count 
towards training. To 'gather this data the LS emd CMI advisor will 
maintain logs fcoa their time of arrival at Stockton. They will record 
the particular activity and tjlae spent in trainir^ the others/ includ- 
ing all staff orientation sessions and walJjthroughmt Copies of the 
logs will be subait^ed to PRC via the BSO at the end -of the preparation 
stage ^d on a weekly basis during the deaonstration. 
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The inforaation frotn the logs will suppleaented vith" infor- .. . 
mation fran the observation of procedures ai)d the periodic intef views 
(Append ix!>K) by the PRC staff. 

f At the end- of the deaonstration the folfowing information and data 
will be obtained: . * • 

• A suEoary of training ti»e for all personnel 

• Problems of inadequate training and ar^s of satisfaction 
will be identified.- 



1 



Fro© this An assessment' will be made of the^'adequacy of the CMI 
advisof's r^e and the need for morfe formal key- personnel training ^ro- 
'grams. peconaendat iojis wMl be* made on the aabunt and type of train- 



ing, and the role 6f-4:h€ CHI Advisor in setting up a new activity. 

^- O^rqanization and Management ^ ' ' 

This objective is cx>ncerned W^h determining the^anization and 
management structure needed for successful operation of orjsite CMI 
courses. There are threie considerations: ' ' , 

• The existing structure at ? base or on board ship 

• The st;cucture .needed to aupport CMI •* ^ , ^ 

• The*(Jegree to which the two can accomm&date each other 
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In this deaonstration -the cooaaaj^S structure for theTleet Center 
at Stockton W shown (Figure ^111-6) , ^jj.fch'' the p^sitioVof * tl«fcM indi-' 
cated. As' the deabnst ration, progresses,' changes will be mad^ in these 
organization and Management structures to elimiriat^ or at leasf allevi- 
ate probleas,.^ It will be necesaary to monitor those changed. |y m^^-- 
derstanding 4^ the changes were made and how will the f;Lnal ^tea 
f^unctions, inf*r«ncea, can be drawn on the organization* and ©atoageaent 
structure »|N<3ed for operational use of/d^» ' 
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The personnel tim^ ds^ta and activity descriptions entered in the 
keV personnel logs will^^tow what is required to. operate CKI, and how 
it can* interfere with routine .operations . Additiona'r insight intQ why 
different 51eaents of the OCT organization and jsanageaent systea 3re 
desirable or not desirable will be obtained froo PRC observations and 
interviews of key personnel and students using the package froe Appen- 
dix K. ,Specificaliy, individual opinions will be sought »ith regard to: 

/ 

• Lines of authority and the levpl at which de<risions are made 
on CMI procedures J - 

Degree of pe^rticipation in decifiioraakijig bj^ch of the key 
personnel . '^-^ 

Plow of inforssation up through the ^^ihain of cocsand to keep 
decisionciakers apprised of the status of the desonstration 
. and of problems needing resolution 

^?iow of inf orfltation to personnel responsible for carrying out 
^the decisions ^ 

Speed at which probless' are identified, decisions sade, and 
solutions lspl«»ente<L _ - - - , . 



-The information sought will vary with the level of authority. The 
following people will be asked to subait to interviews on these issues: 

• Consmanding Officer, NAVCDKMSTA Stockton 

• Coessunicati^as Officer * ^ 

• Division Officer ^ / 

■ • RadioB^n watch supervisors/ Leading Chiefs/ Chiefs of the ^ 

I watch - f 

• • ESO 

• DTC/POS - • - . 
. • ET8 

'. • LS 
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• QCI advisor 

• Students 



The base coessanding officer, the Cosaeun lea t Ions Officer, th^ Divi- 
sion Officersi leading chiefs, chief of the vatch, and.watjch super- 
visors will i>e interviewed to deteYiain^ their level of satisfaction, 
and specific problems and 'suggested solutions concerning: 

• . The reporting to thea of the status of the desaonstration - 

status and amy problems 

• The workload iap::«ed on their staff by the Oil prograa 

• The degradation, if any, of normal station op^iratibns 

• Th^ speed at which decisions to chetnge the CKI C5>eratlo?T are 
xspleaented 

• Any other problems they encounter ^ 1 * 



The SSO, DTC/POs, LS, and CHI advisor will be interviewed . 
concerning! 

• rneir ability to raise probl«is or opportunities for change* ' 
and receive apfyroval . ' _ 

• The prfSrity given CMI aatters in general 

• The amount of tiae given to prepare for 'changes* in the CKI 
operation or cdvanges in routine (^rations affecting their 
work in the demonstration > * 



4 



# Their par^^icipation in routine decisions regarding CKI ^ > 



These people will a*so be asked to Identify other problems, and suggest 
solutions. V ' . ' 

'The ETs will be asked the sase questions as the ESO, DTC/POs, the 
LS, and the CMI advisor. The questions i however, will address the Ets 
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duties in maintenance as well as in substituting for the LS when the 
latter is off duty. The 2Ts will also be asked to assess^ the impor- 
tance c^f their losing tise froca normal duties. 

t ^ 

Students will be asked the sase questions asj^the ETs, with espha- 
sis on the changes tq the student' s watc^ duties^ Thejr will be asked 
to assess the isportance pf the reduction in r»raal duties, and to sug^ 
gest changes related to scheduling or any other aspect of the CKI or- 
ganization ar^ Eanageiaent structure. ^ 

)H the end of the dejsonstratiort an assessment will be made of the 
effectiveness of the organization and.aanagesent structures used during 
the deJ^nstration. Requirements for a structure to support an opera- 
tional OKI systes will be^inferr^, 

\. _ \ 

5. Space Requirei^ents and Operational. Procedures . ^ 

,This obje<^ive is concerned with the extent to which day-to-day 
stjdent and CMI staff procedures "arid the facilities enharK^e or hinder 
the students' progress. In the periodic interviews to be held by the 
PRC staff, the ESO, ETs,. lS^ CHI advisor, arrf students will be asked to 
assess, the adequacy of: ' * 

• Learning center"^pace ind facilities, especially the us^of 
the conference rooa tables for study, lab work, arfeS exarn^H 



X 

The schedmling of^stbdy^ lab ^rk, and exams, incfiKSing* use 
of ^terials , \ f ^ ' 

The schedulirij ofc interaction with the 15 ar^ ^s 

The , tasks artd their scheduling for ' ^ . 

The procedures for keeping student and key personnel Logs, 
entering study time into the computer 
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Figure III-7 shovs the layo-jt of the conrerepce roc© -at- the Stockton 
CoBplex with the location of storage cabinets for Oil aaterial, the-" 
LS*s desk, and the Opscan/ Terainet cLueter. 
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f^tgur^ 111-7 SuxktonCMl Dtmon^oon^^tm^sfC^nw 



T!|^* interview responses will be reviewed by PRC staff and an ae- 
sesssent aade/Of whl^character istlcs are iaqportant for successful 
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operation of Ofl onsite* Inferences will be drawn for large scale 
operation of CMl . ♦ ' . 

I. Squip&el^t^ Kaintenance, Spare Parts, and Logistics Requirements 

This objective is concerned with satters of saooth and effective 
operation, and the reqairesents in terss of the type and nunber of 
pieces of eqjipc^ent, saintenajice response tise^ availability of spare 
parts, ar^ the ease of ry^lacing stocks of spares and exp>en<lable sup- 
plies^ The costs of these are considered in the econosic analysis. 
Here the emphasis is on the acceptabilitv of the operation to the oer- 

t 



The samteriance activities ace as^ollows: 

• Co:sunication li-^-and Opscan/Terainet cluster 'jnder coSitract 

• 'Lab equipcent by STs as part of their watch duties ^ 

• MicrdMche readers by the local distributor at Stockton 

Expendable sjpplies wiH be ordered -try t^e SSO as needed, follovi^ng thfe 
estahlish<^ routine at Stockton.^ <f 



« The observations and per^^ic interviews coriducted by ?RC staff 

address tij^iss^ of personnel satisfaction w^ith the demonstration plan 
for ;e<fuipGient , aaintenancei spare parts, and 16gistics. In addition, 
^ ^each week the PRC sUff will collect the following data frees the sain- 
^enajKre logs and key personnel tlse logs: ^ . 

Respon^se ti^ of maintenance tec!?nician * * ' 

>tai dowTi^tiae 



^tai dowTi^tiae t 

Ruat^r of instances and the delay resulting frtc inadequate 

spares ' ' ' 

. 1 ■ ' ' 
< I ■ 

Unused spares ; ' % . ■ • , 
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• Rubber of instances of ii>«5equate^^s2pply of expendables; 
Opscan test sheets, and afeinistrative forms fPl, P2^ and 
P3); Tereinet paper; time before new delivery " 

I — ^ . 

During the d^onstration the TOC staff vill dociaeent the proce- 
dures and specific activities >^r equipment, maintenance^ spares, and 
logistics. The inforeation and data vill include maintenance response 
ti2^, dovn time, use or lack of use of spares, spares shortages, and 
shortages of expendables.. An assessment 6f the level of satisfaction 
or dissatisfaction with the desonstration'^procedut'es will be obtained 
froes the ?^ observations and interviews* ?rOB(6thiSt requirements for 
onsite deli^JIry of CKI will be derived and an asses^ent cade of h<>u^ 
thjy sight change as the scale of the oa effort conges. 



Conclus-ion 



The research design described here wfll provide the data aA 
analytical procedures to. achieve the objectives of the deDonstrati6n. 
The'scheSuling of these research activities and the assignment of -re- 
sponsibilities to PRC and Havy personnel are described In the p^xt 
chapter. 
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Chapter IV ' i 
I»OHSTRATI0H DESIGN * ' ' v 



on: 



A. Introduction ^ 'A . ' ' 
The demonstration can -be considered^ff' e|lhree part operati 

• The CKI -course, with the activities of studej^s ar^ " , 
supporting personnel v 

• Research activities, conslstins of data collection and 
ar^lysis i 

' 7 

• :5jpport activities, vhicr* pot into place the physical ^ 

J systes5, equipment and saterxal. needed to cerate the .-^ ' 

desoastraticn ' - ^ - ^ 

' , , ' r 

. ^-or &ose people participating in the project t*>ere is 'overlap be-, 
tveen the$6.' areas . Generally, however, they repre/eot a dear separ- 
ation of functions. Kithir/ each Brea, separ'a^e !^eaWnt is given to 
the adtivi ties required irf the preparation, conduct, ar>d evaluHion of "" 
the <iesonstra^icJn. This 4a^ter addresses each of these^areas, prqvi- 
ding a coep^nent by ccepoBent description of how' the desonstration wdll 
be Eade to happen. Where -necessary the detail&^ of day-to-day activi- " 
ties ^re described in teres of what will be (Jpne, who will do it/ whfn, 
and how. a comprehensive descript^n showing how tbe pieces fit to-'' 
gether is given in Chapter VI, 'Dessonstration Master Plan.* 

t 

B. Operatiohs • ^ -f 

This section describes ^>ecific activities w^ich isust be carried 

out during pret>aration, demons bra tiwi, and evaluation in order to offer 
the €H1 BE/E and ^correspondence courses, 
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1. Preparation 

The activities required during the preparation phase are: 

Select CHI and 'correspondence Students 

Assign 'and train an LS for the deaonstration m 

Assign a CHI advisee * 

Conduct" an orient^tion^ session at Stockton for site 
staff y?ho vill support the demonstration 

Schedule the activities of key site ^rsonne! and^^ 
students 

Provide a student orientation^ session and a walkthrough 
of the ccssunication systes operation for^ the students 
and key site personnel * 

Selection of CKI and Correspondence students 
The SSO is responsible for se-lecting arx3 providing ^RC 
with a list^of students vhp have "volunteered to participate in tl^ BE/S 
"Course File 69 CHI cpurse at Stockton, Sttident volunteers xsuat also be 
selected for the correspondence version of the BE/Z course. 



it- 



The ESC is responsible for shaking the program known and 
available to all RH personnel who aigJ^be interested.. Once students 
have indicated that they wish to ^piJrticipate in the CHI or corres- 
pondence course, it will be the responsibility of the gSO to have each 
individual sigri a standard Haval permission lore vhich descrifc>|s the 
nature of the research*, and 'indidates to the volunteer the right to 
disenroll in the project should it becoee necessary. 

It wMl,also be the responsibility of the ESO to collect 
and tabulate the data required foV each* CKI student for registration: 
naEe, social security nug^er, branch of service, classif fcationT year 
of birth, number of y^ars of schooling, Ar»ed Forces Qualif icatJon Test 
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-» .• 



scores, and Ba^ic Teat Battery '(BTh) scores, it will be neces- 
sary to have the sa»e data tabulefted for the correspondence students. 

^ On July 11 the ESO wj^l subeft to ??C a preliainary list 
of Oil vol.unteers w.ith the registration data, bujt with the names and 
social security nusbers covered. These data are to oe used in a trial 
(un by HIISA Meephis of -the BE/E CKI prediction prograa. An estimate 
of coapletion tieies for the Stockton students will 'be secured by July 
15 and used to refine the projected schedules. By August 8, the stu- 
dent lists will be fi.-^liz^ and the ESO yUl prepare the needed regia- 
. tration :nforEatxon using the student registration card foreat s^wn in 
Appendix H. This .inforEatiOD is to be saile^J to KIISA San diego with a 
copy- provided to PRC staff. The latter will 'be at Stockton fr^. August 
8 through the second we|k in Septen±«r. The final estimate of hxpl^ 
tion ti£es will be Bade August 12, when the students are registered. 

^ Begiftni.'>g j-jly 18 the ESO will survey outiyirtg site per- 
sonnel to determine who will take the correspondence course/ The list' 
frilTbe fi.-valized by August 8. , ^ 




h. Assignsent and Training of LS 

It will be the responsibility of C2<TECHTRA to assign and 
.train an LS for the deeonstrat^. The -LS selection acd training will 
be ordjurea by the 'Electronics TPC, with selection by July 11 and train- 
ing to be-initiateiJ July 18: The LS should have- an ETT rating, and ■ 
should be able 4^ spend seven aonths in Stockton, if^it becoee^ iapos- 
•sible to select an LS who can stay on locatiojrv for the entire deason- 
stration, it will be necessary for QfTRSTRA to select sore than one Ls' 
In. order to maintain a continuous full-ti*e position at the Stockton . 
site. 
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c, Se^ ptlng and Assigning a C3<I Advisor 

c^CHTRA Is responsible for selecting and assigning a 
CMI advisor' by July to arrive at Stockton no later than August 20, 
The advisor should be soseone who has considerable experience in the 
CHI training program and is knowledgeable in the electronics field. 
This person will be required to oversee ^he entire operational set-up 
as well as provide ongoing' apprisal of the operation during the first 
weeks of the deaonstratlon. 

/ V <■ ■ 

d. Staff Orientation at Stockton 

On August 22 PRC will hold an orientation meting 'at a 
designated room in the adi^inistration building at Stockton with the LS, 
^OJI advisor, ESO, DTC/POs, Division Of f icers, Cocssunicationa 6ffic^r/ 
and tfje base CoGnsander. The purpose o'f this orientation, expected to 
require one to two hours, is to brief al^ key demonstration personnel 
on the status of the demonstration design, ^Scheduling cf key personnel 
and students and the activities to be carried ou\ l:?y key personnel will 
be discussed. The^ or ieatation session will be chaired by tHle printipal 
investigator fro© ^?VC, 

% 

Beginning on ^^onday afternoon, August 22, and continuing 
throughout the week, meetings of about three hours will be held on 
watch tlH^ with the senfllr aalntenance personnel* These are the STs 
who will substitute for the LS while the latter is off duty. The ETs- 
will alsQ Mintsaln the laboratory equipsent during the deaonstration. 
PRC staff will ^Iso be responsible for this session' with assistance 
froG th^ LS and the CHI advi^r. Since the ETs will serve as resource 
persons, it ^111 be ifisportant to deterpioe how well acquainted they are 
with the course Daterlals. At a. »inl»ts/ two hpurs of this drlentatlon 
should be devoted to a^'feview of each module -topic area with the'LS 
serving as^ the leader of this phase. The rejaainder of the orientation 
Will be ^oted to acquainting the ETs with their equipcBent aaintenance 
j;erfponBibilltles. - ^ . % 
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r 

Scheduling of Activities 

Using the initial estimate of tinie-to-c<xnpletion for the 
CMI course received August 15, the BSO and PRC staff will develop a 
tentative schedule for students and key personnel by August 19, inclu- 
ding review meetings. On the riorning of August 29 an operational 
scheduling session will be held in the morning in the conference room 
at the Stockton blockhouse. The LS, CKI advisor, PRC staff, Division 
Officers, Cotrcaunications Officer, ESO, and DTC/POs frora Stockton are 
required for this session. The tentative schedule prepared by the ESO 
and PRC staff will t>e received. The ^ end product will be schedules for 
the LS and STs over the entire demonstration, monthly project review 
rneetings for key site personnel and testing afnd interviews by ??C staff. 

^ CMI student schedules will be set in meetings with the 
ETs over the week of August 29 to September 2, beginning the afternoon 
of the 29th. The PRC staff, the LS, the\ CMI advisor, and the Division 
Officers will partkripate . 

On the morning of Augijst 30 an operational Scheduling 
session will be held for the correspondence' course in the conference 
room. The SSO, the Cocsaun^at ions Officer, Of f icers-ln-Charge, and 
DTC/POs of the outlying Xites of the Stockton activity, and the PRC 
staff will attend this morning session to schedule the course work for 
students who will be^ taking the BE/I|^qpr resp^dence course at the com- 
ponent sites. The Session wUl produce ^n estimate of the in- 
volvement of the ESO and DTC/TO? wlk> will be handling student tests, 
monitoring students, emd advising as needed. The course materials will 
be presented^ to the DTC/POs by the BSO for dissemination to the 
students . 
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f • Student Orientation, and Student and Key Petsonnel 
WalkthxougE 

^ ^ 

Beginning the afternoon of August 30- and continuing 

through Septembe^2, the students, BTs, DTC/POs, and the ESO will be 
introduced to the course and briefed on '^the operation of the Opd^an/ 
Terminet cluster and the use of materials froii^the learr.ing center? 
The schedule of the walkthrough will have been determined in the work- 
shop of Aiigust 29 and -coordinated so as not to conflict with the-t^era- 
tiooal schedule meeting. The LS and CMI advisor will be required to 
e^ondoct these sessions with assistance frcs the PRC staff. A brief 
meeting of about 20 minutes will be held with the students to describe 
the course. Then, there wall be a pilot run of the c<XE3sunication sys- 
tem, with selected student volunteers taking a sample test, feeding the 
test answer sheet into the Opscan, and receiving feedback on the 
TeriDinet printer. Tune will be spent to anSftSer student questions. 



2.' The Demonstration 

This section presents operational requirements and procedures 
to be followed during "the ^^^^^ of the demonstration for the 
followi/)g: . ^ * 

E)aily and weekly routine for^ the CKT course 

Oil 'student - " 

^Learning Supervisor ^ 

ETs ' ... 



ESO 

DTC/POs 

Coaauni cat ions Offic~er 
Division Officers ' * ^ v 

The Ofl advisor t . . 

Daily and weekly routine for the correspondence .course 

84 



/ 



J 



ERIC 



^K£G 'Report No, 49 

• Correspondence student 

• DTC/POs ^ • ' 

a. ' Stockton Qg Course / 



^ DaiJ^r Weekly, and Monthly Routine for the QQ 

Cours e I ~ : 

'X 

This s^ion provides as overall view of deronsfc^a- 
tion procedures. »The >#Jtin^oj>eraUon involves the students, the LS 
and tb^ds. Throughout the demonst^tioD the students will spend an 
average oAlO hov^s per watch st^ng. Since Stockton is on a rotai^g 
. watch bi^l<\8 shown in Figure IV-1, course activity will be taking 



DATE 
DAV 



01 W 03 04 05 06 07 0^09 10 11 12 13 14 1$ 16 17 18 19 20 2i 22 23 24 25 26 27 ?S 29 30 31 
TWTPS^MTWTPSSMTWTFSSMtwTPSSMTwT 



DAY 
£V£ 

APR^L 
DATS 
DAV 



W23344i1223344i1223344lt2- 23344 
23344112233-44 1' 12233441122334411 
V 12233441 1223344112^334411223^4 



0^ 02 03 04 06 07 08 09 10 11 12 13 14 15 16 W IB 19 ^ 21 27 33 
gSSMTW-^P.SSMT WTPSSMTWTPS 



MiD. 
DAY^ 

Eve 

MAY 

5ate 
oaV 



24 75 26 ^7 28 29 30 
S -M T W T f S 



^ 1 2 2 3 3 4 4 M 
2. r 3 3 4 4 1 1 2 
4 ^ 12 2 3 3 4 4 



122'3?44i122334 
2334411223 3, 441 
1 122 3.* 344112233 



01 02 03 04 05 06 07 09 10 H 12 1^14 15 16 17 18 19 20 21 22 23 
S^lj^T, F S S MTWTFS S MTWTF S S M 



4 1 1 2 2 3 3 
W 2 3 2 4 4 
4 4 1 1 2 2 3 



24 25 26 27 28 29 30 31 
TWTFSS MT 



Mid 

DAY 

Eve 

JUNE 
DATE 
DAY 



441 12233441122334411223 
1122334411 2 233441122334 
344M 1 223344 1 1 223-^3441 1 22 



01 02 03 04 05 06 07 08 09 ^0 11 12 r3 14 15 16 17 18 19*20 21 22 23 
WTPSSMTWTFSSJSTTWTFSSMT^T 



3,4 4 1 
4 112 
3 3 4 4 



12 2 3 
2 3 3 4 
1 > 2 -2 



24^ 26 27 20 29 30 
F S S M T w T 



MID 3441 >22334^'«1 12233441 122 

DAY 41 122334411 2, 233441 12733 

EVE ♦ Vl. 3*4 41 12233441 1^ 2 3 3 4 4 1 1 J 



3« 3 4 4 1 1 2 
4 4 1 f 2 2 3 
2 3 3 4 4 1 1 



FigunlV'1. Sample W^tch Bik 
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place over a 24-bour day, seven days a week^ This activity has to^be 
•'Bodifi.ed, however , fr^ what occurs at a schoolhouse: 

• The CMI corapute£ is not available around the clock. The OCX 

^ concentrator in San Diego is -the controlling factor in allow- 

' \ ing acde^ss to the QiT computer in Meaphis. "The concentrator 
is bn-line froe 0600 to 18B0 Pacific tiae, Monday through 
Friday, so it is c^ly between tt>ose hours ^nd on those days 
that normal student-cocrputer interaction procedures can be 
followed. During this tijae students arriving at the learnin© 
center will submit a Pi adainistrative fons through- the 
Opscan to log in. \ny tests taken by the student during that 
ti»e will be entered in the Opscan as soon as they are com- 
pleted by the student. The computer in Kestphis will score 
^ the tests and direct the student/to the next as^ignaeht by a 

V ♦ sessage printed on the Tereinet. At the end of the study 

period the sti^ent is- to sufaeit a P2 adainistrative far© to 
Tog out. CHI experience shows that students often forget to 
log out with a P2 form. Therefore, it is ie^ortant that the 
^ stude'nts saintain time cards. The LS can refer to the cArds 

and enter a P3 for^ to correct the student's file if a P2 was 
not used to log out. When there is no connection to the CMI 
coKputer in M«nphis, the students can wrk up to the point of 
completing an exaxs. ^ - 

• Only one LS will be available, and only Itonday through 
• Eriday, 0800 to 1600-. 

• ^t any tiee of day there are ETs -on duty. They will be on 
call to handle administrative and course content questions in 
the absence of the LS. In addition, the'^STs are responsible 

A - ' for aaintenaiice of lab equipment • 

m Ho ©ore than half the students at a* ti»e will be penaitted to 
leave their duty station at a tise during their watch tb work 
on the course. This is a requirement to avoid impairing coe-; 
jBunication activities. 

• Since the evening watch is very busy, students will not be 
able to wprk on the CKI course when they have that watch. To 
make up for the course tiBe lost fros the evening watch, 
st^«jnts can-^pend three hours on -the aid watches when the 
work load is low. During d^y watch students can 1:>e expected 

^ to spend two hours on the course, for a total of 10 hours of 
course work per watc^ string. Baph watch string consists of 
six watches jJlus 80 hours off wvering tight coi^lete days. 
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Figure IV-2 shows the effect of these operational 
factors on p>ersonnel responsibilities for a typical -weekday^. The BTs 
participate in the deaonstrettion only in the absence of the IS, and are 
^ responsible for both adainistrative aatters and technical questions. 
Their maintenance responsibility extends across the ^le day! When 
needed to monitor lab work or perforeance tests^ they will spend a ha- 
jor portion of their watch in the learning center. 

When the LS' arrives in the corning', he will enter 
three sheets through the Opspan for each student: .The first is a Pi 
for® stating ah artificial student start tiee such that the period be- 
tween that tiae and the time the L5 enters the iheets into the Opscan 
equals the actual study tiae spent by the student.^ The second fora is 
the test sheet, and tKe third is a P2 fona for logging the student out.- 



follows; 



On a- weekly basis, routine activitjes will vary as- 



• ■ Saturday and SmxJay— The LS will not be on duty, so the re- 

sponsibilities of the ETs will be as shown in Figure IV-2 for 
the Sid and day watche?. The students will folltrw tht appro-, 
priate tiae sheet entry ahdste^t prcxiedures when the. concen- 
trator is down (1830-060© Pacific tiae). 

• Monday— The LS should jr^ceive the Ij^arning center roster from 
Mlia San Diego ^ich stsseajizei* student progress. Consul- 
tations would have to be arrange^* for studenti who ar^ not 

^ doing well. > . - . 

• Friday— LS and CT.cost and tijee^logs ^ill be ^collected by the 
LS- and sent to PRC. MIISA San Diego will *run and aail the 
learning denter roster. 'During the first ^onth rosters win 

' be Bailed on Tuesday as well. 0 ^ 

• All study, test m6 laboratory aatepials, student . 
tiae sheets, aj^ coepleted -test sheets will b« kept in locked. storage 
cabinets in the learning center. The LS w^tl keep the cabinets un- 
locked while working in the learning center. At all o^ber -tl»6s the 
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cabinets will be locked with keys available in the aaster key box in 
Tech Control. A log book will be kept at the box fbr students or ETs 
to sign out when using a key. ^ 

^ . * ^ Bach aSnth^ a review see ting /^"chaired by the LS, 

will a^ess the effectiveness of demonstration procedures and s^hed- . 
ules, and revise thea as appropriate. The participants will be the LS, 
ESO', DTC/POs, ZTs, Division Officers, and Coeaunications Officer. Two 
of these Beetings will be held in the first two weel^s to assure a good 
"9tart for the deaoastration. These first two ae^tirtgs will differ froa 
the general format in that the CMI advisor will participate, and the 
PPC staff^Viil develop the agenda and an assessment of proposed changes 
in procedure or schedule. The aonthly aeeting agenda will be prepared 
by the LS. • 

(2)' The Oil Student 

The general study procedure for the CHI student be- 
gins by reporting to the learning center at the scheduled tlse daring 
the watch. After checking in with the LS or designated Et/ the student 
begins study with the assigned saterials. 

4 

When the student 2urrives at a point of being ready 
for a »oSule ^st, the microfiche test cards wil^ be provide by the LS 
or ET, After successfully oo^leting a ©odule test, the student will 
receive instructions cm the Tenalnet to proceed to the next sodule. 
The IS or BT will provide assigr^nt materials for the next module aiid 
will keep a record of student progress in eac* student's f lie usliig ti^^ 
form from Appendix L. The student will keep a study procedures file 
(shorn in Appendix L) as a b^kup^ and wil^x expected bo maintain 
reasonable progress on course materials based on. CHI .computer projec- 
tions. Should any »tudent fall 30 percent behind^ he or she will b« 
counseled by the LS. . ^ 
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^sscmi^lg these procedures, a time estimate for stu- 
dent progress through the CMI cour^ is presented Figure IV-3. The 
scenario is based on estimates derived fro© the Course File 69 B£/E 
schoolhouse data for the slo^st student. The reader should remember 
that no daita currervtly exists for estimating projected. cocaplet ion times 
for the BS/E course in an operational training environment. This fig-- 
ure is based on the schoolhouse data for students requiting an average 
of 200 hours to complete the course. The figure also asstsses sooe 
"start up" time for each module or lab performance activity and ac- 
couots for soGe vacation lime during official holiday periods. Spe- 
cifically, the following assi^ptions were made in preparir^ the 
chart: • % 

• The dates are estiriated for the l^t group to start the 
course, the group whose watch string doee not 3>egin until 
September 9. 

• Three days are taken off at Thanksgiving. 
Nine days are taken off at Christmas. 

• After returning from leave, studen^ rejoin their watch sec- 
tion the next time it is on duty. 



Based on these assirssptions , the last student *i» expected to finish by 
February 24. ^ . ^ 



I i3] The Learning Supervisor . 

The LS Is required to perform the following activi- 
ties on w*ekd2^s between 0800 and 1600 hours; . 

# * Advise students on the use of the Opscan and Terminet, the- 

use of test papers, maintenance of the time*log and schedul- 
ing of their time, and administer examinations. 

♦ Vhen ipequested, assist students cm substantive questions re- 
lating to course content, their progress, and remedial work 
where needed. This procedure is particularly cr^plal during 
thone tises Indl^iate^in Figure IV-3 as diffloiU* 
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• Maintairr student perfooBance files and schedule, students to 
use the learning center and lab equipeent, administer tests* 
A file cabinet for performance files and other adainistrative 
material will be station^ in the learning center. 'The LS 
should check student progress and other administrative eat- 
fcers at the beginning of each day. 

• Check computer time entries "^{log-in and logout) 'by day stu- 
dents and check later tise data for evening and aid watch 
students. As indicated earlier, this^is particularly impor- 
tant since studeifts may forget to log out with tije P2 for* at 
the conclusion of a. study period, 

• • Maintain the stock of materials / including Opscan test ^ 

sheets, administrative Opscan sheets (PI, ?2, P3) , ejcpe^cl^ble 
supplies, Terainet paper, module tests and exams. There will 
be space available in one of the storage cabinets for these 
materials. The LS will inventory these materials each Friday 

• Request and check on maintenance of the Opscan, Terminet, and 
lab equipBent as needed 

• Coordinate student and ^ activities with the ESO, DTC/POs, 
Coesunications Officer, and Division Officers. A meeting 
will be held once a month to appraise the status of the (XL 
training activities and revise procedures as .needed. One 
meeting will also be held each of the first two weeks of the 
d^onstratlo^* v 



(4) Senior Kaintenance ETs ♦ 

The major ftmctlons of the ETs will be to: 

• . Substitute for the LS 6n mid and day watches ^en the LS is 

off duty 

• Maintain lab equipment on an ''on-call* basis * 

the administrative functions include answering student questloos on log 
entries, providing access to course materials, administering exams, 
checking sttrfent log-in and log-out on the Opscan when the computer is 
on line, and oollectir^ exam papers and student study times for entry 
by the 15 when the computer is on-line. The TOntent-telated functions 
include an«ferj.ng student questions on the cxwttent of the «5arse, and 
si^rvising lab vork and perforsance tests. 
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• - ' All exajB papers and student study tiiaes that are 

collected during cocaputer down tiaes wi^l be placed. in a file narked 
for that purpose in the learning center* storage cabinets. This is to 
be locked by the ETs along, witb all other storage cabinets during their 
watches and the keys kept in the designated bc»c in-Teo^ Control* 

• * k * 

The ETs will aaintain tiae records of their activi- 
ties and will participate in the aonth^y revi|fr lEeetings. 

(5) The Education Services Officer 

The will perfora the following activities in 
support of the CMI course: 

^ . ' M 

• Establish student files containing student registration data' 
for use by LS* The LS will add ti^^cards and other progress 
information as aj^ropriate. 

• Coordinate routine training activities With the Cm course 
- • Participate in the ©onthly r*eview ©eetings 

• Assist the LS in coordinating with and monitoring students 
. e Maintain time records of his activities , 

(6) DTC/POs 

The DTC/POs* responsibilities include: 

• Coordinate Division training with the CMI course 

• Participate in the monthly review meetings 

• Assist the LS in working ^ith Division students^ 

• Maintain tiae records of their own activities * . ' 

/--^ (7) Coaauni cations Officer 

During the deaonatration the Caaaoni cat ions Officer 
will do the following? * * . , 
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> Coordinate the use of tbe learning center with the LS, The 
rooo is' to be preempted whenever needed for Fleet Center 
use. At the August 29 workshop a schedule of routine Fleet 

' Center^oeetings will be adopted so cfti activitiea can be 
\ planned around th«B. The Canmuni cat ions Officer wtll provide 
/ as much advance notification to the LS as possible for un- 
expected meetings. 

I Coordinate with the LS, and approve* tJie scheduling of stu- 
dents and ETs for the respective tasks. This will'be done 
ifiitiaily in the August 29 workshop and revised as needed in 
the monthly review meetings with 'the LS and- other key person- 
^ nel. 

> Serve as a lia^n b^ween CMI training personnel, the Fleet 
Center staff and the base coiamander 



Maintain tiae re<^rds of his activities 



(8) Division Officers 
^ ' ^ The Divt«4^ Officer will be responsible for co- 

ordinating Division activities with the CMI operation. This wiU be 
initially done at weekly aeetings, and later at the monthly meetings. 

Any^unuguai involveuent will be logged and reported to the LS. 

* * 

-W (9) The CMI Advisor 

^ During the first few weeks of the demonstration the 

CMI Advisor will assist the LS and other project personnel as needed. 
The advisor will follow a part-time schedule .of observing activities 
seven days a week and wi'll assist th'e LS in refining operational proce- 
dures and solving probleas as they arise. At the conclusion of his 
stay at tbe demonstration site, about September 19 , the advisor will 
spend a day debriefing 'prc staff. 

j b. Stockton — Correspondence Course Sites - 
^ Individuals at Vhe Stockton outlying *ites will take a 

cor res{k>Ddence. version of tbe BB/B CQurse. Tbe sites are: Mare% 
Island^ ^kaags Island, Treasure Isl^d, Monterey, Dixon, OaHland, ^ « * 
Moffett Field^ and Alameda. 
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Since the correspondence -course Is i^elf-taught and self 
graded, the follwing personnel will participate in the demonstration: 

• The corres]^ndent students 

• t)TC/POs V 

• The ESO ' ^ 

(1) The Correspondence Student 

The Correspondence students will spend an average 
of 10 hours per watch string studying course material/ thus co&ple^ing 
each lesson in two weeks or less. At the end of each lesson, the stu- 
dent will take a self-graded test and s^l t^ test, along with a time 
record, to the KO. Upon satisfying lesson requirements, the student . 
will Dov^^n to the next lesson, thus corapleti^g the course in about 18 
weeks. The^ast student is expected tcr finish by January 20, 1978. 

(2) DTC/POs * i 

Upon requests by the students or * the ESO, ,the DTC/ 
PCs will work with students having difficulty* ^ . 

(3) The SSO - 

The ESO maintains correspoifdence studelit files of 
coapleted tests and time records sent to the by students at the 
off-base site's. These files will also contain the sase personal and 
aptitude data which is used for registration of the CMI student^. The 
complete file will be used in evaluating the students' performance and 
attitudes, will be available ^fcy Jemu^ry 27. • - ^ * 



3, Evaluation 



Operational requireaents during the evaluation phase of thp 
COW SAT project Involve the LS and ZSO. 
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The Learning SuperTylsor . ' , - 

The prUary responsibility of the LS during the evaiua- ' 
tion phase will be to participate in the foraai closing oi fciiTcMl 
coarse. The LS .will receive fhfe Graduate Performance, fummar^. and At- 
trition' P^rforaance Suffloary data froca MIISA San Diego 'and ^iew them 
to determine that • everything is in order.' q/e LS will also chair a de- 
monstration debrie^rng Session with PRCs^aff and key support person- 
nel. This meeting is. to be Announced -innediately-following. the gradu- 
ation of the last demonstration students. ^' % • ' 

• • • . _ # . 

b. The gSO ' 

The'ESO will participate in debriefing. sessions to be * 
^eld .following the cotapletion pf the CMI course. The BSO icHrassidt 
^in adjBinisteflng the conanon performance exam to both the correspondence 
and CMI students, *• 

♦ - 

C- Research ActWilies ^ 

The activities to be carried out in ueet'ing the^ eight research ob- 
jectives^ of the demonstration are described here for eaS^^cbjective. * ^ 
Tf>ere are separate discussions of preparation, demonstration, and , 
evaluation activities for each objective. < 

Learning Effectiveness 

a. Preparation . , / ^ 

f During the preparation ph/se, e;ipefi»€ntal and control- 
groups will be assembled to evaluate the effects of CMI onsite training 
versus CMI training ^center training on learning effectiveness. ^Back- 
ground information will 9e gathered for evaluation efforts and esti- 
aates o/ (xs^lerion tiaes will be coBiputed to aid "in sch^uling the < 
delivery *of tlfe CMI course, -st ' 
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In th'^ first activity of the preparation phase, MIISA 
Memphis will identi^ a pool of control group silSfects using Course 
Pile' 69- historical records of course perforaance data. The entire fil< 
- is to be searched for records of personnel f roa the 24 to S6 paygrade 
who bave*t>iken the BE/E 69 course. By July 22, 197.7, a hardcopy of th< 
results will^be provided t^ PRC for -reviev. By July 29,^977, a con-^ 
trol group of "'sO'or acre subjects will^be selected. . P?c will th^ . ' 
tabulate all of these data on the tally sheet shown ia Apped^flMk 
analysis during the evaluation phase. ^iHP*^^ 

, A group of experimental and' correspondence stu- 
dents will be identified at 'the NAVOOKMSTA Stockton^ rhe BSO-at 
Stocl^tcm will man this inforsation on August "8, 1977 to MIISA San* ' 
Diego for registration of CMI students with copies 'to PHC on site at 
Stockton. -The following deiaographic data for CMI students will be sup- 
plied by the BSO: 

• Social Security Number 

/ ^ " . . 

• ' Hame 

• Rate ^ ' - ^ 

• Brai^h of Service- fNavy, Marines) 
> Year of Birth 

• Yeirs of feducatiorv - 

• Armed Forces Qualifications Tes^ Score , ^ 

• BTB scores • . - * 

MIISA San Diego will code the data on the student registration cartf'for 
the' registration pr9cess (see AE^>endix B^. After tm official regis- 
tration is cooplie'bed by MIISA Sah- Diego, by August U, a <^py of thr 
•learning cente^ resteer is to be B8ile<3;f rc» KIISA San Diego to the BSO 
at St^Icton and to-PW: at McLean, Virginia. / 
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'HI-ISA Meaphis will establfsh'a leading center cocplex 
I.D. nuaber by August 8/ 1977 a?>d notify MIISA San Diego by telephone, 
/ This.inforaatipn'is needed Cor personnel at MIISA San Diego to acco»- 
pMsh the registration of OG students in tjle. sy'st^. Tjiit will be 
dor^e by August 12, 1977,. 

m 

The BSC dt St6ckton will . identify a group of ^ correspon- 
dence students at various NAVO^^MSTA Stockton outlying sites by Augc 
B, 1977 ♦ The ESC will enroll the students in the BE/E correspondenc 
course through F^VS/TRA Pensacola* The saae background data on lev<^l 
of education and ability used for CHI student registration will be/col- 
lected by the ESO for the correspondent students and#us©d by PRC jtQ, 
evaluate correspondence student performance. 

• ♦ 
b. The Dgponstration • ' 

During the desonstration, a coeplete record of all stu- 
dent tljae spent In study and testing for the OG'prograa must be kept. 
For the CHI students, data records are kept by computer as described in 
the Operations section, with a b^u:kup record on a tijcecard as /shown in 
Appendix J, This card will contain a chronology of the studdht^s study 
prograiSi for authorized time during his watch, any^ extri study tiise he 
spends, and lab an^J test tiiae. 



Correspondence students will record study tiie and rela- 
ted activities during the demonstration in the saae manner /as CHI stu- 
dents except the 4ata *^ill not be record;ed in the- computer/ system. 
Mhile this course perforjumce will not be compared to 00 /course data/ 
it will be used wheh the special examination scores are cmp^red« The 
ESO will maintain a summary progress , report on those students using the 
form in Appendix j; • * 
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During the first three weeks of October 1^77, the Stan- 
ford Diagnostic Reading Ires t (Pora-B, the Blue Level) will be aarinis- 
tered by a PRC representative with the assistance of. training personnel 
at the outlying Stockton sites and at 'the aain base* The scoring and 
coding of these data for coiBputer analysis will be the responsibility 
of PRC 6taff . The aeasure of interest in this test will be the student 
reading ability 4core expressed in grade Unit levelSt j 

The testing takes approximately tw6 hours and vill^'^b^^^ 
given to students on their noraal watch. The fijst testing at Stpcktop 
will take place on Monday, October 3, 1977, with the r-est of the week 
used to test those who were not' scheduled for duty on Monday* or who 
missed the first session for sosae other reason* For those %fho are day 
workers, testing will follow the sase prpcedure except they will report 
at socae tiiae during their shifts* 

Because of distances" between outlying sites and the -de- 
sire to test , students on-watch/ Pi^.steTff will not idiainister the test 
directly at those sites. ^ Ir^teadr' the ^RC staff will seet with the 
DTC/POs and arrange for thea to test their students. The PI^ staff 
will visit two sites per day as follows: 

• ffonday October 10 ' ' , * 

0800— Mare Island 

1300— Skaags Island * ' ^ 

- • Tuesday, October 11 , ' - ' ' 

0800— Koff ett Field ' . 

^300— Monterey , ' V ^ , . 

• Wednesday; October 12 * 

0800— Oakland ^ 
1300— Alaaeda ' ^ . 

• • Thursday # October 13* 

0800— Dixon 

% 
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The DTC/POs Wi^ig^conduct the tests during the weejt .following the PRC * 
visit, m t^stiog will be ccjapleted by Wednesday, October 19. 

..^^ PI«: will develop the special exeutination for coi««tring 
student ^achievement though the correspondence course with that for CMI 
by Beceaber 15, The test will be . given on-watc*h by the DTC/BOs at 
Stockton and the outlying, sites, ^ B^b student will be scheduled to 
take* the exaa within two to Mven days after coepleting their .course. 
This will all(>A soee groi^pirw to save ESO and DTC/POs tiee. The last 
^exaa will be taK^^^T^rji^ch 3 and the results sent to PRC so as to ar- 
rive by March 10. . ' ^ * * 

At the <x>nciuBion of the deaonstration, wheq all stu- 
^dents in the experimental group at Stockton have coepleted ,BE/E course 
t requirements^ an adainistrati ve report siEgaarjzing each student's re- 
corded tiB>e data is to be sent by MIISA Me^his personnel to the ESO 
and tbfe LS, and td PPt. The total amount of ti»e required for each 
student to coaplete the course and B5^-«cores will be coded fro© the 
report to the data taliy sheet b/ PRC for statistical analysis. 

. c. Evaluation 

* ' Actual cours^ ccapletion tise data will .be autoeatically 

stored in the CMI computer. The ESO will assist PRC staff in tabula- 
ting this data on the appropriate ESO tally sheet. Copies of the dalsa 
tally sheet are to be filed *ith the ESO at RAVCOMI>^rA Stockton and at 
PRC in HcLeaa, Virgizj^a. 

' ' PRC Staff will <»de c&>urse 'perfor»ahce data free the 
data tally sheets onto computer cards for the analysis', and complete 
the covariance' analysi^ described in-Chapt^r V by March 24. 

By March 24^ PRC staff will also ^ave coiBple'ted the 
analysis of the special achievement exasinatlot^' ' 



100 



' TABG/Report Ro\ 49 

/ 

1. Attltudeg 

Preparation 

. The preparation phase begins with the. OTTECHTRA KeaE^is 

BE/E TPC identifying a group Qf 55 students from the training center at ' 
- Great Lakes and 55 stixJents froi the training center at Mespbis to par- 
ticipate in a pilot validation of the ^attitude instriment. The ar- ^ 
rangeaents for this survey aust be aade so the validation can *be 
conducted the ve^k of July IB, 1977 at Great Laltes and during the week 
of July 25 at the training center in Heaphis. 5^ will adainister the 

validation as well as score and code the data for factor analysis. 

J* 

The procedures for collecting tht^Vdata will be the same 
at the two locations,' The^selected students will report' for th^ survey 
within one day of ccxspleting the Qtl oDurse to' select the session they 
wish to attend. The survey wlfll be administered twice a day, once in 
/ the Dorning and once %n the afternoon, for a weekly total of 10 ses- * 

Each session will last about an hour. During the first 

20 aiinutes students will listen to tape recorded instructions and PRC 

staff will answer questions. The survey itself will take about 40 

minutes. At the end of the hour, one student frca each session will be 

selected to stay for a two-hour detailed oral interview. There will be 

. r 

10 interviews froa each of the two locations. 



^ Scoring and coding of the seaantic' differential data is 

the responsibility of PRC, with th^ factor analysis scheduled for the 
week of Ajigust 1, i977. The.^lidatic^ wilt be cxsapleted by August 12. 



r 



The hour-long attitude survey pretest will be ad^^inis- ^ 
teiTed by a representative begimving August 22, 1977, Scoring and |# 
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« codlrj9 of this data will be PRC's responsibility- Ho imediate statis- 
tical analysis is required for this pretest data* The data«vill'be re^ 

corded on the data tally sheets for later evaluation. 

t - , ^ * 

The procedure for accomplishing thi4 data collection 
begins Monday^ August 22, 1977. During that veek (XL students at 
RAVC0«4STA Stocktoo will report to the training division classroom in 
the administration building at a specified ti»e during their regularly 
scheduled ^tcb. Day workers will report to the testing si-te at a 
specified time during their shift. ' 

Although the attitude control group has not yet been 
determined, the procedujre . will be essentially the sase, with the pre- 
test a&inistered daring the student's CHI orientation. This testing 
will be slipervised by PRC staff, and wiH be completed sometime in 
Rowcberv ^ ' ' 

c 

b. The Deaonstratibn 

During the demonstration phase, attitud^josttest data 
will be collected from CMI studeTits as tHey coj^lete training. 
Posttest attitude surveys at KAVOOKKSTA Stockton will be ^afeinistered 
by PRC staff. This procedure Requires edx>ut one hour to co^lete, and 
will b^ similar tp the pretest. q 

Upon graduatio^, CMI students will report to the >tradn^ 
Ing division classroom in the a<&iLni8tration building where PRC staff 
will be present to administer the survey, and interviews. The same 
staff will score <md code the attitude post tests as they are co^le- 
ted. The posttests will be completed by February 28. 

Q Posttest attitude surveys ^ the control group wlU be 
administered at the corcXusion of tht c</tt»e^n the same room as the 
pretest. The procedurf will be thfe ssm as-for the experiiiental group^ 
and are expected to be co*g>leted by De<^mber 31, 1977. 
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c. Bvaluation 

During the evaluation^ i*ase all attitude tiata irlll be 
prepared hy PRC for analysis by the Bioeed Computer program. Since 
there are seven different attitude concepts being measured in the de- 
Bonstration, each yAll require a separate analysis. The analysis is 
scheduled to proceed issediately following the conclusion df the tnter- 
vievs and vlU be completed by April'l4, 1978. 



3* EconoeH: Evaluation 

a. Preparation for the Dexmstration 

In the preparation j^ase, there are two activities? 

\ 

• PRC will produce four forms by August 20.* 

— Maintenance log 

— Student tisecard 

~ Correspondence course student progress fors 

— Key personnel tin^e Log 

f Sables of these four forms are given in Apperviix J.) 

• PRC wi^l distribute and explain the use of the QQ forms to 
key Stockton personnel at a woricshop planned f or * Augutt 29 • 

• The LS and ETs will be given the maintenance log and see to 
it that contractor jLaintenance personnel fill out the appro- 

.priate log on call, and that the STs keep thea up to date 
when they perfbrs saintenam^e, 

• PiC will provide the with the corresfondence couf^ stu- 
dent progress forE <Sn August 30. » / 

e PPC will distribute and explain the use.of the key personnel 
tise log t<5 the HIISA San piego C^3B5>uter Cen^r Director -Md 
the Deputy Director of MI ISA at H^5>his, 



b. Demonstration Activities 

The data required for the systems, evaluation will be re- 
corded by key personnel during the dea::mstration* As described in ^ 
Chapter^ ill, data colle<^i«^ mechanisaes currently at' the site %riLl be 
otllized and an effort made to keep the data collection requiressents to 
a irinimsi. The data collection activities are as followsi 
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On' the first wrk^ng day of each »onth thje LS will send a 
cjopy of the maintenance log to PRC in McLean, Virginia. 

At the end of the d^aonstration, MIISA ^eaphis will provide 
PRC with a (xeplete cost breakdown of the codBunication sys- 
tem. The data will be provided by Karch lO'. { > ^ * 




Student course tiise will b^ provided to PRC by >^SA H^his 



for the CHI students^ bv Kaxch^lO, Total 'course ti« for 
correspondence student^ will be sent to PRC by the ^0 by 
sase date. 



The weekly subsission of logs by key personnel wiil provide 
the ti^e-odata needed for the econoe^ic analysis. 

The BE/E TPC at p^SSHTKA vill provide PRC at McLeair with an 
itesized costing\>f each shipment of lab equipceht, eicro- 
fiche readers, aici^fiche ^sts, t^xts, answer sheets, ad- 
ministrative forms, ^nd Teralrvet p^^r. The cost data for 
the Augu#1^ 20 delivery wiU ^ sent to PRC at HcLean by 
August ^[I^^.Uter «hipB^t^v:\lf needed, will be reported to 
FRC'vit^^,^.4ffii: of ti*/5et^ery.^ In a<idition, the LS or ET 
will note i-n^i:i^ir*l4:^^^^** ^stances where equipment or 
teriais are not available to student, % ] 

Correspondence materials coits vtll be obtained by PRC staff 
froe the Naval Education and Training Prograe Development ^ 
Center, Pensacola, Florida. A trip will 6e E^ade the week of 
October 17-21 for one or t^ days of data collection. 



c. Evaluation 



The results of tfie desonstration will be use<3' along with 
other d^ta on training cost# to detersine whether revision to the 
cost-effectiveness analysis of CXI is necessary.^ A Jaajor extension of 
the analysis wiil be to assess the potential for CKI use in the Defense 
Depa^rtsent as a wijole. ' ^^'^ 

i By Karch 10, 1978, the economic analysis data will, be 
^available to PRC froe the deaonstration. . Fro* that point until June 1^ 
the demonstration results vill be assessed and conclusions reached cor^ 
cerning the potential role of (XL in Havy training, and in overall 
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Defense Department training, ReooEaendations will be «ade concerning 
future Kavy and Defense Department use of CHI. 



4. Personnel Re<Tuire^nt8 

This objective is concerned with deterai-ning the tasks that 
have tq be performed by onsite personnel and the' level of eflfert re- - 
quired in order support an effective CMI prograa. The personnel of 
interest are th^ LS, ETs, DTC/POs, KO, Division Officers, and the Cob- 
aunications Officer. 



a. Preparation 

Duri^ the preparation for the demonstration the sched- 
ules and tasks ^of key- site personnel will be se'fc. The workshop of 
Aagust 29 will finalize plans. This objective is concerned with asses- 
sing the effectiveness of those plans. 



b. De^nstration ^ 

PRC staff wi^l observe the operation oontinoously over 
the first two i#eeks, and then interview' the stt^nts and key personnel 
to see what jiight be done to isprove tasks or schedules. The' interview 
will be repeated ,twp weeks later, then once a sonth unti^ the end of 
the deaonstrat'lon. The intervleN^ question related to^th4s objective 
cah be found in the total interview package contained in A^ppendlx 



. Key personnel time logs will be reviewed by the PKC 
.staff eac* week as they are received froe the ESQ. ^rtiat Information 
plus the interview responses will determine If any changes in task 
assignment or level of effort- are warranted. If there are, the aK>ro- 
priate recomdiendations would be made by the PRC st^ff after 
consultation with key site personnel. 
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; When approval of a change is nectswry, the PRC -staff 
vill sufc«lt the recoBBiendations in writing to the a«eunications 
Officer., 

c. Evaluation 

At the end of the c5e»onstration in February 1978, the 
time log data and interview responses will be studied by PRC staff to 
assess the support pezsom^lTf^Tr^'pet student. The extrapolation 
will tnfer the personnel requirements for an (^rational CKI onsite 
systea. Conclusions will be developed by April 7. ' ^ 

5, Personnel Training Requiregents 
I This objective is concerned-with determining 'the training 

needed for site staff si^jportlng CXI courses.^ 

r 

a. Preparation 

During the desonstration, the LS will receive IT-K/E 
training, and together with the CKI advisor, will train the ETs to car 
ry out their responsibilities. Tise spent by' the LS and Cja advisor- 
with the ETs will count towards training. To gather this data, in the 
preparation stage the LS and CKI advisor will Mintain logs free their 
ti©e of arrival at Stockton. Onder ■Adainistratlve Activities" they 
will record the time spent and the particular activitj^ In training the 
others/ including all staff orientation sessions and walkthcooghs. 
These LS and oa advisor logs will be accumulated up to the start of 
the demons trat ion, 

b. DeMonstratlon 

During the d«aonstration<- tb« LS and CKI advisor will 
aaintain t^Lt t£«e logs. . . 

^ \ ' 
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The observation of procedures by the PEC staff and the 
periodic interviews to assess the effectiveness of operations (Appendix 
K) wni address the adequacy»^f the training* The schedule of c^servd- 
tion and interviews described for identifying pefsonnel requirements 
will be followed here. . 

* 

c. Evaluation ^ 

beginning March 13, after the end of the desonstration 
and in parallel with the asrsessssent of personnel requirements, the data 
and information on training will be studied and the actual amount of 
training time for key personnel sissaarized. The interviews will iden-' 
tify probiesis of inadequate training as well as areas of satisfaction. 
An assessment will be made of the adequacy of an advisory activity dur- 
ing the ^isonstratlon versus more coeaplete preparatory training. 
Reccssepdation^ will be made on the aia^unt of training for each key . 
site person, the subjects to be covered, and the schedu^le of that 
triiining. This evaluation will be completed by April 7. 

6. Organization and Management 
*^ This objective is «6oncerned with determining the orgatilzation 
and management strWture needed for successful operation of onsite CMI 
courses. 

a. Preparation ^ 

^ • - 

The workshop of August 29 will finalize the organization 
of the -demonstration. The interview package o^ Appendix I has been de- 
veloped to address the capabilities and deficiencies of the organi- 
\ zaticm and management structure, and bow the CM q?eration can 
interfere with routine duties. 
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b. D«K)n8tratlon 

Organization and managesent functions will be observed 
>*by PRC staff continuously over the first 'two ^t^ks and for several days 
each month thereafter. The first major interview using the cjuestions 
frco Appendix K will be given at the end of the second week. Addition- 
al interviews will be given at the end of the first month of the deaon- 
stration and once a month after that. The interviews will precede each 
progress review meeting. 

c. gvaluation ^ % 

The results frota interviews and PRC staff observations 
w>il be studied beginning April 10. Pr'oe the interview responses, the 
organization and- management structures used during the desonstration 
will be described- and subjectively evaluated for effectiveness. The 
evaluation will be coc^leted by April 28. ' - 

7. Space Requirements ^and Operational Procedures 

This objective is concerned with the extent to which the fa- 
cilities and day-to-day student and CMI staff procedures enhance ot 
hinder the student's progress. ^ 

a. Preparation 

The facilities will be in place by August 20, with two 
storage cabinets and an LS desK provided in the Building 120 conference 
room. August 29, the learning center will have all the lab equip- 
jient, microfiche readers, and course print materials, and "the Opscan/ 
Terminet cluster connecting to the CW computer Ci Memphis will be in 
place. 

^ b. Dem^tration 

In the periodic interviews to be held by the PK: staff, 
the EOT, BTs, LS, CXI advisor, -and students will 'be a&l5«d to assess the 
adequacy of the procedure and facilities* 
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c* Evaluation 



A description of the facility setup and operational pro-* 
cecjures folloved th;rougbout the demonstration will be prepared by PRC. 
The interview responses wll3| be reviewed by PRC staff and an" assessaent 
isade of which characteristics are ii^ftant for successful operation of 
CHI onsite* inferences will be drawn for large scale opexation of 
CMI. This evaluation work will be initiated May 1 and completed by 
May 19. 

8. Equipeient/ Maintenance^ Spare Parts^ and Logistics 
Reqajireisents 

This objective is concerned with ssooth and effective c^ra- 
tion, and include"B requirements for pieces of equipeent, maintenance 
response time, availability of spare parts, and' replenishment of stock 
and supplies. The costs of these requirements are considered in the 
econoEsic analysis. The following paragraphs esphasize the accept- 
ability of the operation to the personnel* v 

a. Preparation 

The equip©ent and spares required for the demonstration 
will be in place by August 29 » Maintenance for the coessunication line 
and the Opscan/TerBinet cluster will be provided under contract wbile 
ETs at Stockton will maintain the lab equipment as part of their watch 
duties. The microfiche readers will be maintained by the local distri- 
butor at Stockton. Finally, the ^0 will order expendables as needed, 
foUowipg the established routine at Stockton* 

Demonstration 

•The observatic^s and periodic intervie%rs conducted by 
PRC seaff address the issue of personnel satisfaction with tbt demons- 
tration plan for equipiftent/ maintenance, spare parts^ and logistics. 
In ^ition, data will be TOlli^ted from the maintenam^ logs and key 
personnel time logs ea^ we*k by the PRC staff. 
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c» Evaluation ^ - - . . 

The PRC staff will document the arrangeiients for equip- 
ment, faain'tenance, spares, and logistics. Perfbnaance aeasures will be 
suroarizfed in terms of the maintenance response time, down- time, use or' 
lack of use of spares, spifes shortages, and sbcyrjtages of expendables. 

Interview and observation results will be used to iden- 
tify the level of satisfA:tion or dissatisfaction with the demonstra- 
tion procedures. Requirements for onsite delivery of CHI will be 
stated, and an assessment made of how they might change 2UJ the scale of 
the Oil effort changes. The evaluation will begin May 22 and be com- 
pleted by June 9. * 

D. Support Functions 

" This section describes the coasunications system, lab equipment, 
facilities, and print and other support materials required to carry out 
the demonstration. 



!• Coggauni cat ions System , 

■ > 

a. Systes^ Configuration 

Servicing the demonstration co e aa uni cat ions needs re- 
quires an unconditioned voice grade telephone line connecting the 
Opsc2m/Terminet cluster and the San Diego CMI concentrator. Three land 
line alternatives were considered (as described in Appendix'^M) and a 
dedicated cosaercial line was Selected for the demonstration. This al- 
ternative is expected to cost on the order of $500 and $550 more, 
respectively, than the other two dial line altern^tives^^cxmsidered.^-* 
The latter, however, would require Extensive* software »odlf ications 
accor<Hng to Honeywell 'and Pacific Telephone. Ho firm cost estimates 
were available, but the work would easily cost f 1,500, eliminating the 
advantages of Mternatlves 2 aisd 3 over the dedlcated^coeaBerclal llne^ 
In addition, th« tixe and effort required to revise Honeywell's con- 
tract for the OC concentratCMT would be «li«inated. 
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Details of the coopariwn of these three alternatives, 
including the cost consideratipns, are contained in Appendix H. 

Qpscan/Terminet Cluster 

The CKI systeo requires afn Opscan i? c^tical reader and 
GE Tertainet 1200 teletype terminal. Xs described earlier, student test 
sheets^ a're fed into the Opscan the infonaation is transaitted to 
the CMI cooputer in Memphis via the concentrator at San Diego^ Aiter 
the test is graded, instructions to the student are printed out on the 
Tenainet. < 

A cluster consisting of one Opscan ind one Tenainet will 
be placed in the learning center. A second cluster will be kept in the 
^ET storeroom in the blockhouse as a spare. The Opscan and Tenainet 
will each be on a table with castors so they canJje rolled into place 
quickly when needed, [ 

^ Maintenance of the Opscan and Tenainet equipoent will be 

provided by the respective contractors, national Coiaputer Services 
(NCS) will Miintaip the Ops<;^n,^'Snd Honeywell will have the responsi- 
bility for the Tenainet. In each case, .service will be on call. The 
, availability of a single spare for each coapon^nt of the cluster is 
considered more than adequate based on MIISA experience. 



Preparation 



. { 



By July 1, 1977, CNET will have tasked the CKI Systea i 
•Manag'er to bask MIISA >^phis to do the following: 

• Lease, via CXDKrtAVTELOOM, a two pair, type 3002, full duplex, 
unconditioned line free StocRton to San Diego. Bell 202-T 
nod ems shotald be used at each end of the line. The line will 

. ^ ^ be activat« August 29, 1^77/ at the latest. 

• Have Boneywell install the RP6352 asynchronous jLine modulator 
at San Di^ by August 2'9, ;977. ^ 
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Provi'de Stockton with two installed and operating OPSCAH/ 
Terainet clusters by August 29, 1977. Delivery will take 
place by August 20,* 1977. 



By July 15, HIISA Meiaphis will coaplete contract nego- 
tiations with Honeywell for the following: 

• Delivery of two Opscan/Terainet clusters to Stockton by . 
August 20 ^ ' 

^ ' • Installation and checkout of one cluster at Stockton by 
August 29 

• Maintenance of the cluster on-call by Honeywell for the 
Teminet, HCS for tSe Opscan 

• Installation of the RP6352 asynchronous line Eodulator on the 
CMI concentrator at San Diego by August ?9 

By the same date, HIISA must initiate riegotiations 
through COMNAVTELOOM fqr a contract with Pacific Telephone to provide a^ 
dedicated phone* line between Stockton and Sam Diego. - j 

On August 1 the Opscan/Tenainet clusters by Honeywell 
and NCS will be shipped. August 20 is the latest date for, delivery of 
tfie cluste^rs. ^ ^, 

^ . On August 29th Pacific Telephone will have an operating 

'J^edicated line, including aodems, between Stockton and San Diego. 
Honeywell yill have completed installation of the asynchronous line 
raodulabor tc^ tie in the CHI concentrator in San Diego. Honeywell and 
^ ,HCS will also have ocxapleted installation and checkout of the cluster 
^ there will be a fully operational CRI network on that date. 

, d. Defltonstration 

Maintenance will be provided by l^^cifi^ Telephone ifcr 
,the dedicated lirte and »od«as, by Honeywell for the RP6^2 asynchronous 
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liM •odulator and Terainet on call, and by BCS for the Qpscan. The 
system will be used^utinely beginning SepttMber 6 and will be closed 
down by Ptbruary 28, 1978. 

The aarntenance log will be kept op to date during the 
d«onstration^for the Opecan, Teminet, and the dedicated line with »o- 
deas and the line ©odulator. 

The Oi^anAentinet cluster will be disconnected by 
Honeywell and RCS cm February 28 and the units shipped to 'a site desig- 
nated by MIISA^ On the 28th the dedicated phone line will be discon- 
nected by Pacific Telephone. 

e. Evaluation 

~ ^ 

In the econoefc analysis^ cost, down ti»e, and, mainten- 
ance data obtained from the demonstration will be used^to assess the 
cost effectiveness of delivering CKI to remote sites. That sfcudy will ^ 
be finished June 1.. The effectiveness of the maintenance program and 
the reliability of the system are of interest in the analysis of equip- 
ment, maintenance, spares, and logistics requirements to be ccetpleted 
June 9. 

2. Laboratory Equipment and Microfiche Readers 

Vable IV-1 lists the labferatory equipment and microficl^o 
readers needed for O^urse 69. The cost of the^ equipment totals about 
§6,200. X 

The equipment needed for the demonstration Is standard tor 
Course 69 except that testing versions of the VBM boards have to be 
modified. X lock box will be added over the test control knobs because 
the boards will be used for practice as well as testing to reduce the 
aaount of equipaient needed. Since it would be possible for students to 
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Table I Vh. Bquiprmfit Litt for BE/E Count 69 





Unit 


Tot»l 


1. 




1138,00 


1 


552*00 


Z 


Thf»eRCAOtcikMcooeTyptWO*33A ''^ 


I27W0 


1 


825*00 


3 


ThTM BCO V^o^ei 337Si9r^ Gtnirttor 


1120^ 


1 


300.00 


4 


Thft« RCA VW-77B Vt^ 


1 69^ 


1 


207,00 


5 


Thtm WG-343A Difact/Lo*»-Cap»c«y>c« Probt Wd C«M 


1 ISjOO 


1 


45.00 


6 


Tf»r*^ Devices 














$ 


000.00 




Two N E,A T TfBrw>5 E>«v^/1« 


1300.00 


1 


600 00 




Two K.E.A T Trttfuft^ E>ri9C« 12a 




$ 


800.00" 




► Two N E,A T Training Dfvic* /8 ^ 


1300.00 


1 


600.00 




Tvo N E.A T Jmnrig D«v>c* /7 


1300.00 


1 


W.O0 




Two N LA T Trtcn^ D«vfc» /9 


WO.OO 




600.00 


7 


Tw«*vet>fy CeUi.i 5v 


$ 3,00 


1 


36.00 


8 


Pour Hook-up Wiref (OH the th«m 


1 roo 


I 


8.00 


S 


Pcuf S«tsof K4tt6f u»ds lOff me them 


1 4.00 


1 

1 


16.00 


10 


Two tScrtfichi H%9dee% 


$175-00 


1 


^.00 




TOTAL 




199,00 



decipher the variable settings of the test knobs during pract4ce, secu- 
rity has to {>e prqvgi|^ in the fona of a lock box. The LS and BTs will 
keep the keys* 




By 'July 1, CHET will have tasked CSTECHTRA to provide: 



Two full sets of HEAT testing boards on a no-fcost loan, modi- 
fied witB a lock bc»c covering the test contrpl knobs 

The t^ and number of iteas of ^urse 69 lab equi^sent 
needed for 50 stu<i^nts 
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This wlU be shipped by Aogu«t 1 «nd delivered to Stockton by August 20 i 

^ The LS and ^ BT will, check out the lab equipient ^xA 

microfiche readers on August 25*. Repairs or replacements will be ar* 
ranged as needed, • 

b. Demonstration 

The lab equipment vill be used by students under the 
supervision of the LS, or. in ET^ben the LS is off duty. The micro- 
fiche readers will be used for Oa tests. 

Maintenance of this equipment will be provided by BTs. 
-^I^re are no data availaBle on maintenance require&ents, but the staff 
" using the equipment at CKTBCHTRA Memphis see to i»ed for major effort. 
An estimate of 16 ho^rs per aboth has been made by PRC to cover main- 
tenance. 

A maintenance log will be kept. The microficbe readers 
will be serviced by a local distributor. ^ 

The LS ar«J CTs will keep a record of equipment use to 
identify whether or not the provided equipment is adeqtiate aj>d 
' necessary, 

c. gyaluation 

flje ooet and frequency of repair data viU be t»ed in 
the eronomic analysis. Equipment and maintenance needs for onn^ite CKI 
will J&e asses;^ based on' t^ use data and results from interviews and 
ob^vation. The study will be completed June 1. 



r 



3. Facilities 

■ The learning center yrill be located in the blockhouse 
(Building 120) conference room. T« large conference tables^ arranged 

i 
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in a -T- shape, will zmAiM, Spe^ce l«^^^T»tUEa« at one «Dd of tfi« hxai 
for tW OpBcan/Terminet clester, ta#o ^standard alx foot high.^etal «tor- 
age 9abiDet«, and a aall detic for tbe-tS, TI» eabioeta, which wiXl 
contain lab equipiwnt, atody »at«rial«, aod aicroflcdit r««Sers wiU be 
locked when not in u«e. Figure III-7, in Qapier iii oo evaluating 
facilities, sbovs the diseasiona of the rooi ai^ poaaible pl«ce»ent of 
the equ4p»ent. 

.V 

h MAxiMiM of five trair>e«^« Is expected it any ooe ti*e lor 
scheduled study, testing, or laboratory vork, Others «y coifee in oo 
their free time to Krve ahead in the \fOrk or do r»edt^ vork, The 
trainees will work at the conference' tables. | 

SUff ©eetings vlll have priority over OOKISAT for t2se of the 
conference rooe. In order to aini«i?e disraptioo of coorse work, an 
effort will be sade at Stockton to schedule sUff ©eetinjs several days 
ahead. This would. give LB enough tiae to adjust trainee schedules 

^ c 

for working In U>e center. * 

a. Prei^aration ^ 
1 By July U, the Stocktc^ ESQ will also verify that two 
storage cabinets and a desk csp'be provide^or the le^nlag- center. 
B» August 2d,: the 2S0 will have, equipped the learning cttter vith stor- 
age cabinets for course «terials and <^ip»entr and a dest for the 
LS. fiB soon as the »a^^rials and equip»4st arrive, the will have 
thee stored In the le^n^ng ^center. 

o 

f • * 

.On Aogust 29, a workshc^ de*ilog-Blth the »cb*Sul«8 and 
taska of the personnel t*kiDg parfc*lii the de^onl^atiop irlll also *d- 
dress the sci>edaling of the learning <»nter. Provl8i<» will be Mde 
f.or neet CenUr st*ff c¥»f«r«nc»s. . It U «5*ct«d that ti»r» rlli/be 
little Tariatloo froa the agreed apoo'scbedal*. 
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The learning ctnttr vill r«»aln open 24 bcmrf a day. 
However, vbtn FlMt Center staff oon£ereiK»a art held aH OCX activi- 
ties vUl stc^ and CXI personnel irlll leave the confe^nce rooe. 



During the vtek, the LS viU oosxipy ti^dfrsJ; in the roc« 
fro« J«00 to 1^00 hours. The rest of the time the CTs vill be on call 
to co*e in and pro^de assistance. 

The observation and periodic interviews of stu<Sents and 
soppcrt personnel by PK: staff will provide data on tbe adequacy of the 
.facilit/ for the CXI oourse. By F^ruary 2B^, the equipment and ma- 
terials ^vill have been' returned to CHTBCHTRAi the OF*can/Terminet clus- 
ter sbiK>ed to KIISA, the fho^t line discoroected, .and* the storage 
c^inets and LS desk remove^. 



c,. gvaluati(^ ' * 

The assessment of facility r»eds vlll consider user 
.satisfaction based cm the interview results ^nd observatidcs by ^CC 
staff. The adequacy of the space and organization of the roa« vill be 
^ a^es6e<5. Infer^n^s will be drawn on the requirements for an opera- 
tior^l CKI systea in the evaluatioEi study to be coi^leted Hay 19, '^^ 

4. Print and Other ^terials / 
The following' materials will be provided hf the agency indi- 
cated in par ^theses s 

• Teh copies of BB/B Owrst 69 cx>re ■odule (1-14) textf 
{CBTBCHERAI \ M 

e . Short and long Opscan test ar»fer sheets r lab sheets, ^ 
administrative for». CPl^ P2r P3)r Termlnet paper (GKSCHSi^) 

# Student and B^ippozt personnel log sheets CPJS:) \ 

^ • &q>endable supplies su^ as pens, pencils r P^9f^ (&Cf^Oi%^STk ' 
Stockton) ... r ■ ' 

■ . ^ c . , 
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In addition, the SSO will order oorreffpondence ooutM ftaterlal frcs the 

C 

Haval BducatloQ and rrtloin? Progras Develof^nt Cantar in Penaacola* 

a, Praparatlwi 

By July 1, CSBT \dll bava tiaked CST2CHTRX ho provide 10 
sets of Course 69 texta, »odulM 1-14, and enough teat sheet*, mipro- 
I fiche teats, i$b papers, ^Opscan administrative foms (PI, P2, P3} , and 

% ^ Termjnet paper to scpport the experiment. These will be delivered by 

August 20, 1977, and stored in the learning center* 

By July 25 the ESO wil> order the corre^ndence 
materials « They are to be deli<vered by Xugxist 23. 

b! , Deaonstration 

The students will be given access to the materials by 
the LS, or, when tbe LS is off duty, by the BTs substituting for the LS- 

During the demonstration, tbe periodic interviews and 
observat^ions by PRCZ staff will obtain information on any bottlenecks 
that ma^ ex|^ wit^ respect to materials. ^ x 

c. gvaluatlcm 

^ h judgment will be -made by the PIC staff on whether or 

not tb^ materials -were ade<ioate in nta^r and availability. Implica- 
tions might be dra^ on requirements for an operational oa systa. 
However, tbe test gase is amaU for this subject and it is doubtful 
strong oooclusions can be reached* Tbe analysis will be completed by 
June 9. 
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Chapter V ^ 

r) 



A. Introdoction 

" J ' 

A^occeMful deaottstration will requirt coordiMtion &nd support 
froet a niaber of conaands and opferating units within the Bavy. This 
copter describes the specific tasking required ifithin the Ravy to car- 
ry out the d»<^istratIon. 



B. Organ izajtional Resfionsibilities 



^es fionsit 
tnere az 



Ifithin the Havy trfere are four grouf^ involved.^in the tasking t 
CX»«AVTEIX30H, *CHTECBTRA and KIISA, 

C3?Er is responsible for preparing , and Issuing the tasking. The 
tasking for the cowunicatioo lines has to be ap^^roved by ca^-54at>^* 

G0KHA\nSLODM will be responsible for proving the use of ccmli 



cial leased lin^ to connect. Stouten with San- Diego / inclading the se- 
lection of Bodems bo connect the lines with tSe terminal equipment. In 



gaining thIFltpproval, justiflcaf^on for tbe use of oCMiercial lines 
instead of available Eavy AOTOOZH linM must be sboim« Tbe argw^ta 
'presented in the preceding chapter and Appendix M on the seZ#<^ibn of 
the coBKunicitioo lilte provide tbe basis tor this ju»tificatioe» 

'c wi ^ CH TBA will be responsible for providing a learning s«5>erviaor, 
the BB/B O^ursr File 69 laboratory eqtiipsent, and the textbooka^ test 
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forms, answer sheets, and .other sateriaLs related to the course. The 
co^ti as8^>ciated with these iteaa are to be ooverefl by CHBT, 

MIISA will be riesponslble for providing specifications on the co«e 
Munication lines ahd iiode«s, ordering and delivering the OPSCM?/ 
TBRMIKET clusters, and providing student data^both in preparation for 
and during the deaonstration. Because of a change fn ownership of the 
manufacturer of the OPSC^ equipment, KIISA will have to work out an 
agreement for the additional cluster. These negotiations may be 
lengthy and require an early start in order for the equipaient to be 
re2tdy for the deaonstratJfon. 

Three types of student data are required from KIISA in order to 
efficiently carry out the desonstra^lpn^^/nae first type consists of 
project iorts of time to ooepletion for students with the skill levels 
representative of the volunteers at: Stockton. This is to be obtained 
by enrolling the volunteers, if tbey are known, with names and K>cial 
security numbers masked^ oy& fictitious sft of students with represen- 
tative aptitudeUevels. The immediate 6u1^t of the CKI coaputer will 
provide an^estimated time to oc«^letion. Once that is obtained, the 
enrollments, fi^Ttious or actual, will be erased from the ooi^ter 
files pending enrollment of the final set of studenti at W>e l?eginning 
of the demonstration. The second type of data required is routine 
progress reports for the students actually eJ^rolled in the demons tra- 
tt^ As indicated earlier these will be mailed by KllSk San Diego, 
initially twice a week and then on 'a weei^ly basis^ to the learning 
supervisor at Stockton. ^«^tbird set of .data will contain information 
on the learning effectiveness rantrol group^and will be ^rived fro» 
historical da^ contained in^'th^CXI coi^t^r ftt Mei^i^. Two steps 
are required^ to obtain that data, ?irstr files will be searched to 
identify graduates of the BS/E Coarse ?ile 69 with p^ygrade levels in 
the B4 to S€ grot^. On» a omtrol group has b«cn identified/ per- 
foraanc* data on time to coi^letioei will be obtaioed. ^ 
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m addition to stixtent data, miSA peraonnal art to provide PRC 
with data on personnel time e35>eDded for the OOKISM* project, 

I 

C. Taakinq Letter 

The-4a#Wng letter to be issued by CKBT villi 

• Set deadlines 

• Initiate long lead-time activities" 

• Khere additional work is required before requir«ents are 
ooBpletely known, allow reK^loticm of details between the ap- 
propriate Havy groq? and the project staff at PRC 

In addition, to ensure propef coordination of all *act^vities, the let7 
ter should clearly specify comonication links between the Havy, groups 
participating in the' demonstration, the rec j^roject staff, and CHBT. 

The tasking letters should detail tBfc following activities to be 
carried out by each organizaticn: 

f m KIISA 

— MIISA San^iego to register the students, and prepare^ 
and aail stud^t reports twice a week for first month/^ 
weekly thereafter' 

— MIISA Memphis to ^tablish a Complex^dentificatlon 
ber for tbe Stockton tr^e^i esti^tte time to cc^le- 
tion for a grot^) of traiaes rwresenUtive of Stockton 
based on data supplied by PRC 

^ All involved sectiocs of HllSh to submit all costs and 
time charged to«the project in a form suitable for 
analysis as i^ecified by PRC ' - . . 

• CimSCHTRA 

< 

— JOa Synttm Kanager to task MIISA' to provide Stockton 
vlth tMO installed and operating 0P^3M/7er^eet closn 
ters by Aogost 29, 1977. Delivery will take place by 
Augost.^^ 1^ 
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— Oa SystM Hanager to t&iW HIISA to lewf, via 
COMKAVTELOOM, a two pair, type ^3002, full dt^lM, artccm- 

. ditioned line tzom Stoctcton to San Diego. Bell 202-^ 
»odes8 should be used at easA end of the line. The line 
vill activated Augtist 29/ 1977, at the latest l 

— CKI Syate* Kanagex to task MII5A to have Honeywell in- 
stall the RP6352 asynchronous line modulator at San 
Diego by August 29, 1977 

— To provide 10 sets of Coarse 69 texts, aodules 1-14, an^ 
enough test sj>eets, microfidie tests, lab papers, Opscan 
adjsinistrative forms (Pl, JP2, P3) and Terminet paper to 
st^jport the experiment. These will be delivered by 
August 20, 1977 

* 

— To provide two full.^ets of HEAT testing boards on a 
no-cpst loan, ^fiodified with a lock box covering the test 
control knobs; to provide the type and nia^ber of itgis 
of Course 69 lab e<^ipsient needed for 50 students. This 
will be delivered to Stockton by August 20, 1977 

— To train and assign an LS to arrive at Stockton by 
August 20, 1977. The IT-BE/B training program will be- 
gin July 18, 1977. If necessary, more than one LS will 
be used in sequence to^maintain a. full ti^ position 

— To identify and maintain files on a ojntrol group for 
attitudes . 

— HB/B jpc to assist in identifying a group of 55 trainees 
to validate the attitude test at Great Lakes Training 
Center, 55 at >$e«phis. The contact at Great Lakes would 
be identified and all arrabgements made by the TPC. 
This will begin by July 5', 1977 

To assign a staff me^>er to oversee the setup of opera- 
tions^at Stockton. Dates to be specified 

~ To submit all costs and time chaurged to the project in a 
fom, suitable for analysis as specified by PRC 



A sample translation of these requirement!^ into a tasking letter 
is provided in Appendix H. 
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^ Cbaptef VI 
DEMOKSTRATIOr? MASTER PLAH 



This <±apter chronologically describes the preparation, conduct, 
and evaluation of the d^onstration froa completion of this report to 
evaluation of the results of t>>e desonstrfftion. Figure Vl-l is a flow 
chart of tb^ activities. 

A. Preparation 

^Opon ooepletion of the demonstration design, CNET will provide 
tasking for actions to be taken in preparation for the demonstration. 
These tasks are described in Chapter rv. 

By July 11, the 2S0 at Stockton will provide PRC with a represen- 
tative list .of student characteristics baseiL^ the Chief's survey of 
potential' volunteers for the CXI course. By July 15,. KIISA Mesiphls 
will register these students in, the B2/B Course Pile 69 to predict cob- 
pletion times* The students will then be dropped item the file and the 
resuits given to PRC staff for use in flnallrlng the demonstration 
'schedule.' The PRC staff will be at Hea?)bls when, the data are obtained. 

Also by July 11, th# ESO at Stockton will verify that two storage 
cabinets and a des^ can be provided tot; the learning center. By July 
15, the K/B TPC at COTEOfTRA will assign an^lndividual irt>o is familiar 
with the BE/E Course Pile 69 as a^CW advisor to assist in settlhg 
the demonstration at Stockton. 
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An 13 will be identified by CHTECHTRA byf^uly,ll» Also by July 
11, the BB/B 7PC will arrange for the LS to begin any rtecesMry IT-BB/B 
training on July IB. ^ ^ 

By July 15, MIISA Keftpbia will complete contract negotiation* with 
Honeywell for the following^ 

• .Delivery of.rbo Op»can/Ter»inet clusters to Stockton 

August 20 . I 

• Installation and checkout of one cluster at Stockton by 
August 29 

• Maintenance of the cltater on-call by Boneywell for the Ter- 
ainet, by HCS for the Opscan ^ 

• Installation of the RP6352 asynchronous line aodulator on the 
oa concentrator at Sar^ Diego by August 29- ^ 

By the sase date, WISA «ust initiate negotiations through OOHKAVTEL- 

* • 

OOH for a contrafct with Pacific -Telephone to provide a dedicated phOTe 
line between Stockton and San Diego. 

/ " • 

The training of the LS at the training center in Kesphis or San 
Diegor BE/B school will begin July 18 and finish August 5, On the sa»e 
day,'PBC staff will begin a week-l<»)g validation of the attitude test 
with 55 -students at the Great Lakes training center* 



On July 18, KIISA llaqphis wiU begin a file seardi of Coarse Fil^ 
69 records to Identify an historical set of cwitrol data for students * 
with sixilar BTB sTOtes and paygrades frop B4 £o Upon conpletion 
of this search, PIC st^ff will screen the results and select a control 
grocp by July 29* ^ ' 

Beginning July 18, th« ESO »t Stockton will farv«y of fsit* p«rsMt- 
nel to deterainc nuabtr vbo will t«k< tbe correcpondence 
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courser On July 25, the 2S0 will order the necessary ttA and test «a-^ 
tirials fro« the Naval Education and Training Prograa Develop«ent Cen- 
ter in Pensacola. 

During toe^^wee); of Jul^^JS^lS, PRC staff will ad»inister the sec- 
or>d stage of the attlfcdxle test validation to 55^041 students at the 
Meaphisr training center. 

On August 1, there will be two shipaentsj (1) the C^scan/Terainet 

clusters by Honeyw^l and NCS, and (2) Course 69 print aaterialf lab 

equipsent, and oicrofiphe readers by CNTECHTRA* Also during this week 
S 

the gSO at Stockton will finalize the list of volunteers for both the 
CMI course and the 'corre'spondence course." 

on ADgust 8, with student lists ccoplete, the ESO at Stockton will 
prepare the. needed registration information and provide copies to San 
Diego and the PRC staff who will be* in Stockton August 8 through Sep- 
tember 16 • ^ ' . ^ 

Also on Augi^t 8, MH;S*-i!^phis will establish a Complex Identifi- 
cation Nuaber for the CKl/learning center at Stockton and notify KKTST 
San piego^of the file ni«ber so the lat^r* can hanJdle adsinistrative^ 
actions on the* coKputer for StocktOT. 

On August 12, MIISA San Diego will^egister the Stockton OC stu- 

ft 

dents and mail copies of the initial -i±ater to. the BSO at Stockton, enft^ 
to PRC in McLean, Virginia. The roster should be received at Stockton 
on Monday, August 15, at which tine the BSO and the PRC staff at Stock- 
ton will schedule student course activities based on the estimated 
course coiW>letion time cpntain^ In tfte rdster. A tentative schedule 
^111 be prepared by August 19, and revised in a planning session sched- 
uled -tot August 29* ^ 

f ' ■ . ns' _ - 
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August 20 is the last day for arrival of the LS and the CKT advi- 
sor and delivery of the Opscan/Terminet clusters* and the course mater- 
ials and equipment. By then, the ESO v^l have Equipped the learning 
center with storage cabinets fpr course materials nxA equipment, and a 
desk for the LS. As soon as the matcTrials and equipment arrive, the ' 
ESO will have them stored in the learning center. , ^ ' 

The correspondence course materials are expected by August 23. On 
August 25, the LS and an 2T will check the lab equiWnt and microfiche 
and arrange repair or replace^nts as needed. 

By August, 26, the PF«: staff and the ^ wili^ailnister the attl- 



. tude pretest and interview to the CMl students l ^fc ey personnel. 

Beginning the afternoon of August 29 aiid continuing throughout the 
week^ the on-'watch orientation meetings will^'be belH with the Els'. 
The^ meetings, which will last, three hours, will pre^re the ETs>for 
their roles as substitutes for the IS and as maintenance personnel for 
the lab equipment* 

On August 29, Pacific Telephone will have an operating d^icated 
line, including modems, between Stockton and San Diego. - Honeywell will 
have ooTOleted insUllatioo-of the asynchronous line modulator to tie 
in the CMI concentrator in San Diego. Honeywell and :BCS will also have 
coopleted installation and checkout of the cluster so there will be a 
«fully operational CM network 0| that date. ' 



A workshopSKll be held on the morning of August 29 to develop a 
complete scheduling program for the opi^ration of the CMI <»urM. At 
this- wor>c«bop, the IS, OtI advisor, Pac staff. Division Officers, Co»- 
■unications Offictr, ESO, and DTC/POs ttam stocjjton wiU develop a 
schedule for . the LS and BTs over the expected dtiratiort of the^ oxirse. 
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Beginning the. afternoon of August 29 and oofttinuin^. throogbout the 
week, Meetings wiU be held with the BTs to set student schedules. The 
PBC -staff, the LS, the CMI advisor, and the Divisldo Of f icers' will par- 
ticipate. 

beginning the afternoon of August 30, and extending through Sep- ' 
teaber 2, the students will be briefed on the course. The students, 
ET8, DTC/POs, and will be walked through the operations of the 
cluster and the use of the materials in the learning center by the-LS 
and (XL advisors. These walkthroughs will be. scheduled in the workshop 
of August 29 arp coordinated to avoid conflict with the BT-aeetings. * 

B. Deaonstration 

' Tuesday, (.Sesteaber 6 will begin the dcKjnstration. The LS or BT 
will initiate each student into the systesi as they arrive. For thedu- 
ration of the course, the- students will devote an average of two hours 
per watch to study, lab work, and exaas. The last student is expected 
to finish by February 2\. When the course begins there will be" a re- 
vised estimate of the end date. I 

.'^ / I . 

.. The correspondence course students will also begin on Septeaber 6 
and are expected to finish in about 18 weeks, assuaing an average of 10 
hours per watch string. Allowing for holidays, they will finish by 
Jahuary 20. A revised estimate of coi^letion will be made by the KiC 
staff for, the August 30 workshop using ti»e-to-coii5>lettoD estimates 
froa MIISA. • ' ' 

I 

The Oil course wiU operate ander the- direction of the LS, with 
the BTs substituting on adainistrative matters and technical Questions 
when the LS is not ofx duty^ The BTs will also maintaih the lab e<juip- 
aent. Student progress reports in the fora of learning center rosters 
will be provided on a week;^ basis by WISA'Saa Diego. The reports 
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will be pjrinted and mailed Friday at San Diego for receipt by the LS at 
Stockton Monday, i During the first »onth, an additional rosUr will 
be mailed out ofv each Tuesday. 

\8 the CM cpurse progresses, adjustmenU will be made to schei»- 
ule? and procedures for students and OTs. During the first two weeks, 
at least two meetings to discuss changes will be 'chaired by the LS» 
The participants will be the LS, oi^advispr, DTC/POs, Division 

Officers, CoMunicatlons tJfficer, STs, and PRC staff. PRC staff will 
observe the first tw weeks of the course and develop an agenda for the 
first two me^stings, plus an assessment on proposed charges to be dis-^ 
cussed in the meetings. Improved schedules and procedures will be 
generated. After -the first two weeks, monthly meetings will be scbee- , 
uled to^coincide with visits by PRC staff. 

\ In order to gather d*ta and information on CMts, personnel time, 

and proi^ures, support personnel at Stockton (the LS, CMI advisor, 
ESO, DTC/POs,. BTs, Division Officers, and Ccoaunication Officer) will 
maintain logs of their activities. Tl^ Divisic») Officers and Comeuni- 
cations Officer will note the 4^ spent by any 'staff w>t keeping a 
log. These logs will be collected each Monday by the and' forwarded 
. tp PRC at McLean, Virginia. 

Him i>er»onnel^: Sa». Diego and Heiphis will also report time and 
activities deiroted to, tlSe- pifojtct. The Coeputer Center Director at 
MIISA San Die^o will sen^gp wwkiy report to PBC at McLean each Friday 
on cost* and personnel^ti;^. ■ The Deputy Director KllSA'at Mesph^s 
will report any signifi^si, costs or tl»e spent on the demonstration in 
a *^ekly- report. 

In additibij^to tbe'oost afld ti»e data, PRC will conduct routine 
interviews with, CM s^^nts and kty 8i??>ort personnel to assess bb}# 
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yt^ll tbe (JeaKKistratlon Is* fuactionirig In teras of personnel tim; per- 
sonnel training needs, organisation and »anage»ent strocture, facili- 
ties, operational' procedures, and logistics. These . interviews will be 
given at the end of tbe first tvo 'weeks, tbe* first aonthr and ea<di 
■onth thereafter until the end of tbe deaonstration. 

* * 

The students in the correspondence course, which will run concur- 
rently with the CXI courser will also work an average of 10 hours per 
watch string. There will be little formal infraction with st?>port 
personnel in the correspondence course and tbe t>TC/POs at tbe off-base 
site will forward student tests to the ESO, who will review ti^ and,) 
at the end of tbe course, forward thea to Pensacola for grading. Tl^ 
ESO will assist the DTC/POs in -counselling students having any problesis, 

Several sp^ific events will occur during tbe d»onst ration. 

# September 19 tbe QCI adviscfr will return to Mesiphis. 

• FBC staff and tbe Stockton EgO and DTC/POs will administer 
the Stanford Diagnostic Heading Test to (XL stoctents during 
the week of October 3-7, and to correspondence students dur- 
ing tbe week of October 10-19. Tbe results will be used in 
assessing CKI student performance in the BE/B course 69 and 
both groui^ on the special achieveaent. 

# Tests and intpviews to evaluate attitudes will be a^nis- 
tered to a control group of e^^rienc^ personel attending a 
cm course from a land site. Tbe dates and loc^ti<Mi will be 
set by PRC and COTBOfTkA, with completi<» empec^ Sovem- 

^>er 15. Since tbe students will be working full-time on tbe 
course, the time between tbe pretests and tbe final posttests 
may be as little^ as six weeks. Tbe ^ntrol gro^ testing and 
interviewing is ea^ected to be completed by tbe end of D^em- 
ber. By December 15, tbe special* exi^ to be used Ln compar- 
ing tbe effectiveness 6f tbe CHI aM correspondeoM course 
^ wiU be designed. 

• At the completion of ^be correspondence course {«cpec^ to 
erd by January 20, 1978), tbe ESO will coq^lete the student 
files and send a summary of -student time-to-ooaplete and 
t&l performance scorM to PBC at McXf^an by January 27. 
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Tbe 4«on*tr»tion vill be cl6»t<! ds*ra by P^r«ry 28, 1S78. On 
February 24 tbe la»t stodent^ 1* expected to log oot, end ott F«brtt«ry 27 
KIISA San Diego will Mil out tbe Grediiate Performance Sosary and At- 
trition Student Performance S«try to p^ at Kci^n and tbe LS at 
Stockton. Tbe 2S0' will collect and forvard bo PKC tbe r«aining ti*e 
«>d cost logs. 

Tbe Opscan/Termibet cluster ^^111 be diicorm^ed by; lia>eyvtll ^ 
RCS on F^ru^ 28 tDd tbe units ^shipped to a mitt desigaated by 
niSX. klMo by February 28tb, the dedicated pboo^ lifte will be discoo- 
rvect^ by Pacific Telepbone, tbe ESO at Stoc*tofi will ship tbe Coarw 
69 materials and equipment back to OTTECSTPJ^ at Keasi^is, tbe learnif>g 
center viU bave tbe (»binets and LS deak reeved, ar^ tl» LS will . / 
leai^e Stockton to report for new duty elsevbere. Tbe LS vill bavt co&- 
pleted tbe oa student files aiid subeltted all tbe appropriate rerords 
to C^raCHTPA in Mesphis, Tbe ESO vlll keep vbate^r is desired for 
Stockton files. 

For each CXI student, tbe attitude tefts and interviews irill be 
adsinistered by PRC staff, or tbe ESO and D«ypOs, vithln ODe veek fol- 
lowing ooKpletion. ^ On February 28f the test and interview vill be ad- 
ministered by tbe PRC staff to key support per^m^l, 

Evaluation 

After tbe deaoostration, PEC staff will analyse- tbe reaolts in 
terms of tbe eight j^aearch objectives,, in additiwi, daring tbe »a*k 
fro« February 7 to Karcb 3 tbe ^>eclal acbiave^t czaas vill b« taken 
at Stockton by tbe oa and correspondence students . Tbe pcrforsancc of 
tbese grocps will be abalyied by PSC staff. 

PRC iflll have tbe folloiririg data and information in hand mi tabu- 
lated by Itarch lOt 
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« 

• oa tiJie to cc3Bpl#ticm * 

• Attitodt test scores for both stodtftts raj kty ptrsormel 

• Attitude interviews for both students and key persoemel 

• Cost data 

♦ 

• Personnel tl»e dftt« arii •ctivity de«cription* 

• Equipeent and Logistics Usage 

• Intervievs vith etodent* and key personnel on the operatic 
of the oa coarse 

f 

A total of 'foor weeks viU be reqaire^ to analyse the data related 
to learning effectiveness and attitudes. Tbe ef fectiTenesi will be ae- 
co^lisbed by running a standard oovariance analysis pacScage <» the 
coapyters in K^,ean to cc^re CKI stodent performance at Stockton to 
the historical Coorse PUe 69- data obtained free miSA Kesphls. Re- ^ 
s.alts vill be obtained by Karcb 24. 

The attitode pretest and posttest daU frc* the «cperi»ental CW 
grotqj at Stockton win be co^red to the daU froa the oa control 
grot^. A oovariance analysis will also -be run oo the PSC oo^>eters, 
witij results obuined by Mardj 31. The interview anawers will be used, 
to^ adjust tbe interpreUtloo of the sUtistical analyais ot tbe tast 
scores. All tbe attitodMaalyaes will be oo^l^ted 1^ April 14. 

Coats and persomwl ti»e data will be used to assess tbe coat ef- 
fectiveness of oa ocsite training for tbe Kevy and tbe Deparfaeent of 
Defe&M. Tbe coat of major oa ooaite activitiaa ^1 ba •stimatcd and 
co^reM to cooventional approecbaa. This work will be eoBpla^ by 
Jtae 1. 
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Tbt rtMining objectives coDcern ptrftormel, ptrKsfcel trtiningr 
organisation, jtra procedural and loglatics rtqulrt»entt, and irlU be 
dtUt with Ui that ©rdtr. 8»cb u«ei the peraottfttl tiat d«t* aod the 
interriew information c»i profale» facejl and actual or potential »olu- 
tions identified. A case atwiy appro«:& will be tt»ed to aasestt 

• Operatiohal effectiveneaa of tbe d«»oft«tratieo design \ 

• Desirable or required a^anges to acbleTe an effective opera- 
tional systes 

Personnel and personnel training requirements will be studied and 
conclusions reached by April 7. The organisation and management struc- 
ture requirements will be studied next, with results by April 28. Fa- 
cility and procedure requirements' will be assessed by J<ay 19, equiF»ent 
and logistics requirements by June 9. ' ' 

The co^ete report on the demonstration will be presented in 
draft form July 15, 1978. 
/ 
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PRESENT VALOE ANALYSIS 

/ 

When two programs have different cash flews over ti^, a basis of 
cospar ison is needed othet than the ye^ly co^ts or savings. Present 
value concept provides sixrh a basis. It representi^the current value 
of a cost or savings that will occur^at'a specific future time. 

because it is possible to invest aoney and obtain income fros it, 
receiving Sl.OOt) tod^iy is worth aore than 'receiving $1,000 two years' 
froQ now. * Specifically, assise that a 10 percent annual rate of return 
can be obtained for carefully invested soney* $1,000 today would be 
worth $1,210 ($1,000 x l.l x 1.1) at the end of two years-. Therefore, 
$1,000 is the present value of the $1,210 received at the end of two 

Whea deciding^ between alternative Msh flows, it is preferable to 
choose the alternative with the highest present value, all other fac- 
tors being equal. For exasple, consider an offer of $900 now or $1,210 
in two years. The present valoe of $1,210 is $1,000 and is larger' than 
the $900 offer. Based on present value it would be preferable to wai^ 
two years for the $l,210» The choice is conf iraed -by considering thtt 
the $900 invested now would yield only $1,089 In the saae tise period. 

Costs are treated in exactly the saae aanner. The present value 
of spending $1,210 at the end of two years is $1,000. If the ciK>ice_ 
were to spend. $1,100 new or wait two years and spend $1,210, all other 
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things being-equal, it would be preferable to wait two yearfe beCAe 
spending the money. 



No raatter what the cash flow over time, positive or negative, it 
can be reduced to a present value by the forsula. 



" X(2) x(n) 

?V = X(0} - - : ^ . , , \ 



where Xfn) » cash flow in yjsar n 

r «^ average rate of return fpr tb^ year 
# 

The tera discount rate 1$ used instead of rate of return in the 
isore general consideration of public investments ar>d in particular in 
Defense Department applications. Discount rate vill be used in the re 
mainder of this discussion. O^en, the cash flow is unifors over a 
year. If r is the rate of return for a full year 



?V = XiOt ^ — -i- ;: — ;: — + 

(1^) (1^)2 (1^)^ 



Mbe-n the cash flows ajre identic2d f ros year to- yeztr and are repre-* 
sented by a 

PV » I 1 + — ' + * . . , + 4- . . . 
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Sooetiaes, when a fixed present investaent is being compared to^a 
cash flow over tiae, the equivalent annual cash flow is desired. That 
is given by 



1 

1 * 



J 

tI^ selection of a discount rate r, Is very isportant in analyfir>g 
present value, A char^ge in r could change the choice 9f/prograii, ?or 
Defense Departsent prograes, Reference 3 specifies a value of 10 
percent. 



?or OOHISAT, a prograa life of eight years (corresponding to the 

life of the terminals) was selected. For any component of the progran, 

such as an individual course or terminal, the present value. is calcu- 
lated as follows 



° - r.2 „ r,8 



= a 5.S97<a ) 

o c 



/ 
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Where ts the fixed invesrtiBent, the annual cost, the discount 
rate is 10 percent and the program life is eight years. 

Because the CMI courses have a life of 12 years, there is some 
value regaining at the end of the eight year prograa. Assteaing uniform 
depreciaticm over 12 years, one third of the initial, investment remains 
at the end of eight years* That value' could be^ transferred to another 
program if COMISAT ended and CHI continued at 'th^ training centers, or 
it could be charged to later years of an extended CXHISAT operation 
along with other annual costs arK3 savings. Hence the present value of 
the remaining equity is an equivalent savings. If the developing and 
coding cost is 

a^ « 5522,750 * 

as it is for a course 51 days in length, then the remaining equity at 
.the end of eight years is a^3 « $522,750/3 » $174,250, and the pres- 
ent value of this equity is 

^8 ^*c/^' " 0-4665 /$174,250). - $81,288 

Consistent with the Defense Department instructions of Reference 
3, the present value concept yas used to describe the projected net 
benefits of COMISAT. The reader is referred to that dociaent for fur- 
ther inforaatioh on (inducting and presenting eodno^c analysis results 
for Defend Department programs. 
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Appendix B 
REQUIRED WJTODIN II CAPACITY 



lAs discussed in TAEG Report Nuaber 44 (page 219), each 10 student 
hours of training will require a transrsission of 1,087 characterS> f roca 
the reaote site to the CMI Ccsputer and 9,174 cherf etchers froQ the CHI 
Computer back to the r^ote site. These transaission requireaents as- 
sume a batching of 10 aessages together to^ncrease coismunication 



•"'•'•1 



For purposes of determining the size of the transmission line re- ' 
^quired to and fron the CMI Costputer, the larger of Jthe two transai^ion 
requirements aust be used* Osing the character f sties of the repres^en- 
tative COMISAT^^,|i^raa of Table II-l, the nustber of student training 
hours per /year is: 

{20,8ar students/year) ^967) (255 hours)^ - 5,148,941 student training 
_ ^ hours per year 

Thus, the totar nuaber of characters per year to be transmitted to the 
CMI Cooputer center Ist 



(5,148,941) (9,174) _ 4,723,638,473 characters {>er year 
■ 150 (Aaracters per 



^A88i»lng an average course length of 255 hours. 
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This transmission requirement should then be cx)nverted into ^an ap^ 
propriate sized transmission link between the nearest AUTODIN switch 
and the CMI Computer and the cost of such a link calculated. Incidently 
the* net cost of the AUTODIN lines required should be calculated as the 
difference between the total cost of the AUTODIN, lines and the cost of 
the additional d^dica^ed lines required to operat^^e CMI skill pro- . 
gression courses at the training centers, -Neither of these costs is 



available at this time. ^ 



Similar calculations could be made for .the additional transjaission 
requirements the-COMISAT system .-imposes on the menage center at each 
remote site. For the ^8 sites iitc^uded. in the represe/^tative case 
this amounts t6 an average addJ^ ^^ ^yload of 0.28 characters j>er 



0. 
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Appendix D ^ 
ESTIKATIW 0? COURSE 2KRDLL«SHT DA3»l 

As 5sentiof>e<3 in Chapter II, the data on Ir^dlvidual enrollments for 
skill progression courses was ILsited to the title, length, and nusber 
of graduates of the 10 courses vith th& highest voljse. The lac«; of 
data necessitated generaticn of populaticms for courses ar^ apprcocii^a- 
tion of such enrollment quantities as avexage atter^iance and st^xient 
san-days, T^is appendix provides further details about the procedures 
used to arri'^e at these estisates. 

A ♦ Generating Course Populations 

The basic assjr^ption uMerlying the generation of estis^tes of 
course '/olx^es is that the derived populations have the sa=;e proper- 
ties, i.e., can be fitted by the sase curve, as the peculations of the 
10 highest volisse courses. With this assumption, the required popula- 
tions" can be obtained by fitti#>g a curve through the populations for 
the 10 highest volume courses and extrapolating this curve to obtain 
the needed populati^s. These steps are described in greater detail 
below, 

1. Fitting the'curve 

As Figure D-1 illustrates, the course populations sees to 
follow an exponential curve. A learning curve vas oaed to approximate 
these populaticms because such a curve i^ exponential in shape, is rel- 
atively slBTple to derive and aanipulate, and provides a close approxi- 
aation to th« dSita, This appendix contains & discussion of the learn- 
ing-curve and its properties. 
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A process foIlc?i#s a learning crjrv« if the accunulated averse 
he deper^ent v^arlable decreases to a consta/st percentile of the 
previous accumulated average value whenever the ir^eper^en£ variafcflfe 
^doubled. For exa^le, if the popjlations of the high volase courses 
follow a learnirvg curve, then, by «^abli'ng the number of courses, the 
accunjlated average student poj^jlatic^ Is decreased to a constant per- 
cent of the previous acciiitulated average popuLatic^. The constant per- 
centage mentioned above Is called the learnir>g rate, k learning curve 
with a 70 percent learnir^g rate Is plotted in Figure D-2, • 



To determine if the course populatiw data follows a learn- 
ing c»ve the accusulated average populations for ^ach o:>urse were . 
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(1! 

Hfghwt Volum* 
CourM Numb«f 


12) 
Sums 


(3) 

Accumulated, 
Aversge j 


1 


3,110 3.110 


2 


4.433 


2^16.5 


3 


5.807 


1.8© 


4 


6,567 


1,641.75 


5 


7.178 


i.4;s.6 


6 


7,786 


1^.67 


7 


• 8;J72 


1,196 
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8,884 


1,110.5 


9 


9^ 


,1,031.67 


10 


9,685 


968,5 
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deterair^d^ and- used examine the learning rate. .Table D-1 contains 
these accuQulated average pop-jlations, which were foufVd by dividing the 
cuQulative population by the course nunber. The learning rate can noJ 
be estimated by perforai^ the oalcul^ations given below where is 
the accjnsjlated average population of the i^^ course. 



C 



ft- 
J' 



It -^s r>ote<3 that all of these ratios are fairly close to 70 
percent. In fact, their average is 69.8 percent. Hence, a 70 percent ' 
leaning ejrve sensed to provide a reasonable approximation to the 
co^jrse population data and was used in obtainir>g subsequent course 
popjlations. 

The next step in arriving at these coujse populations was to • 
determine the algebraic fors of the particular learnir^ curve to be 
used. The algebraic fora of a general. learning curve is 

\ 



where, for purposes of this analysis, Y^^ is the accusulated average' 
nu^^^er of students over H asurses? a Lb the nuabe? of students in 
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cours4 1; H is the number of courses; and i is an exponent associated 
with the learning rate. In this equation ^ „e variables, a 

i« e constant \^hose' vaTiie^ ig a constant 

whose value isust be derived, 

4 

* 

To derive i the learning curve forRuia was first aj^lied to 
the second and fourth courses, which yields 



respectively. Dividing the first of these equations by the second 
suits in 




due to the relationship between the accumulated average populations. 
Applying the logarithm function to both sides of the equation? the 
value of b was found to be .516, Hence, the sp^iific fors of the 
learning curve whic^ was applied in this analysis is 




2. Extrapolating the Curve 

The accusulated average fiopulation for the eleventh and sub- 
sequent courses can be determined by substituting the couree msiber for 
R in the formula previously derived. These results are ibowi in Colusn 

.D-5* • . 
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2 of Table D-2 for courses 10 through 18. However, the course popula- 
tion, not the accuitulated average* course population, is required. 
Course population can be obtained froe the accumulated average popula- 
tion by ereploying the followir^ steps; v-. 

o For course 10 and all subsequent courses, multiply the ac- 
cumulated average by the course nuiEber, K, to firvd the cussu- 
lative n-jnber of students in each of the N courses. The 
^ results of these calculations are shovn in Coljran 3 of Table 
D-2. 

o Subtract the cunulative pop^ulation for the H-1^^ course 

froQ the cumulative population for the H^^ course to find 
the n-jsber of st*^ents takiryg the K^^ course. The result- 
ing course enrollments can be found in Column 4 of Table D-2* 



Tdb^ 0 2 Approx Tjsre C^rrutsu^ ar?c? Cojrse f^OQu^ attorns 

\ 





(2) 


(31 


(4) 


N 

Courw Number 


Accumulate 
Average 


Fitted- ' 
Cumulative 


Course 
Population 




947 9 


9.479 
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902 4 


9 926 


447 
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' 827 9 


10,762 


403 


14 


796.8 


11 155 


393 
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1V534 


379 


16 


743 8 


11,900 


366 


17 


720.9 


12,255 


^ ! 


18' 


©9S 
i — 


12,^ 


343 1 



B. Approxtsation of Enrollisent Quantities 

Two enrollment quantities were approximated In thia analysis: 
average attendance student man days. 
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^ . Average Attervdance ^ * 

' The average nunber of people enrolled in % course at any 
given tiae was detenaioed fros the nunber 'of graduates, using data frc«3 
Table II-5, The average nuisber of students isi 



entrants * graduates 62,909 ^ 61.66 6 
2 2 



Average attendance can be obtained fros the nuir^r of graduates by: 

total average attendanc e 

( nusber of graduates in the course ) 

total nunber of graduates 

= 62,287 rcourse graduates) » 1.01 ^course graduates) 
61,666 

2. Student Kan Days 

The nui^r of student can-days required by a course vas de- 
termined by sultiplying the average attendance by the course length. 
With the exception of courses one through ten, all courses were asstxsed 
to require 51 days, the average course length for skill progression 
courses. 

The results obtained by theae procedures were used in the 
econosnic analysis in Chapter II. 
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Appendix E 

DETAILS OP THE CALCULATION 0? COSTS/ SAVINGS, 
BREAK -EVER POPCJLATIOKS 




The components of costs and savings were described in general 
tenas in Chapter II. This appendix presents the details of the tech- 
niqjes used to calejlate each cost elesent so that the reader aay ver- * 
ify the analytical results. 

A. Costs arv3 Savings Incurred Through Developtsent of CMI Courses for 
Training Center Use ^ 

Course Development, Coding and Maintenance 
As discussed in Chapter II, developing a course for CHI in- 
struction and coding it for use on the cocaputer requires an increTOntal 
expenditure $2,OS0 per hour of training. The number of training 
hours in a course was detersined by first multiplying the misber of 
calendar days by 5/7, to obtain the nuaber of 'working days required by 
the course. Multiplying the result by 1 , the number of training hours 
in a day, yielded the hours of training required by a course. The de- 
velopment and coding cost were then found by; 

Developaent and coding cost per course: ' 

» ($2,050) (calendar days) (5/7) {1) |1| 
^- ($10,250) (calendar days) * 

The annual course maintenance cost was estisated by taking five percent 
of this Incrcaental expense of developisent and coding* 

♦ 
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2. Computer Expansion Cost 

The TOciponents of ccHsputer expansion costs were also discus- 
sed in ^Chapter ii and an annual cost of $14,400 for each t^Knjsand AOB 
.students was determined, AOB can be fQund by dividing the average an- 
nual attendance by the nun^er of successive courses in a year, whicK Is 
^365 divided by the course length in calendar days. Therefore, AOB is: 
(average annual attendance) fcourse length in days j 

365 

and annual computer leasing cost Is: 
S14 400 

' ) (average annual attendance) ( Course length in days j 

1,000 355 

= S.0395 (average annual attendance) (course length in days) • (21 

V 

3 . Terminal Costs 

For each 60 AOB students taking CMI at the training center an 
additional terminal ©ust be purchased and maintained. Assuming courses 
can share 'terminals, the number of training center terainals required 
to service a course can be found by dividing the nus±>er of AOB students 
in th? course by 60. % 

The investisent and maintenance costs of a training cfm>^r 
terminal, frc^ Table II-7 xn Chapter II, are $14 ,250 and $147/Bonth^X^ 
spectively. The eight year present value of total cost of one training 
center terminal is: 

$14,250 t 5*597($147) 12 » $24,123- 



Therefore^ the present value of a training center terminal <x>st for any 4 
course 6an be found by : - 



E-2 



-164 



TAEG Report No. 49 



^ Counse AOB {$24,123j t . - (3) 

60 - 
4- Savings in Student Tim^ and L:iving Costs ^ 
• . Tb^Aving in student man-hours of training with CMI con^ared ' 
to cx>nventional traini^ng is the product of the number; of AOB students, 
l^e percentage of time saved by, CMI, and the annual rate of pay for 
eagh student, ^e annual salary,^ including basic pay, quarters, incen- 
tive and special ply, retir^ent pay/, and raiscellaneoufe expenses, was 
assuj^fd to be $10,690, the salary of a st^ent witti an E-4 rating T As 
indicated m Chapt^^r II, a 20 percent decrease in tra.ning time was as- 
suroed* Thus, the annual saving in student salary is: 

(AOB) (.20) ($10,090) - $2,018 (AOB) ' ' 14) 

Incremental living savings* was derived m a similar laannef by 
multiplying the average annual number of. st"udeots, average number of 
days saved, and incremental livtng expense saved. The average number 
of days saved was calculated as the pro^ct of the number of calendar 
days -in a course and t;he 20 per^^t time savings factor. The incremen- 
tal living c3at saved is $2.-50 per day. So^e annual living cost sav- 
ings was determined , by: ' ' ' •/ - 




(average -njjmber of students) lealendar days) ($2.50) 



> - $»50 {ai?#rage nOaher^^Tstudents) {calendar days) (5) 

.B. COHISAt Costs and Savings for Training Center Justified Courses 
1. Terminal Cost . * 

each the first 17 courses through COMISAT, the 
only cojts are for terminal purchase and mairkenance. For the low 
maintenance case, the ondiscounted terminal investfij^nt cost is the jilbr-, 
beiT of sites 'aultiplied hy the unit terminal price of $H,450J For the 

' -2-3 
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high maintenance case with assignment of spare terminals, th^ saiae cal 
culation is n^de but the number of terminals to be purchased' is in- 
crease by the spares, 

Spare parts investment cost was deterrjiined similar to- term i- 
nal cost, usi^g a spare parts unit cost of $6,529, The discount for a 
particqlar number of terminals or spare parts sets was found by taking 
tj^e Sisn of the discoun"ts in Table 11-10, weighted by the number of 
units in each discount groyp.' For example, if 80 units are 'needed the 
*total discount is; 

OJl) 4 51(29) + 101 (30) 15%(20) = 745% of the unit tenainal cost 
The grOap*and cumulative discounts can be found in Table E-l, 

J able E- h Group and Cumufd^/ve Quanvty Discounts 



Units 


1 — ^ 

'Pepcent 
Discount 


V Numt>ef in 
y Group 


Gr^up 
J^Qunt(%) 


Cumulative 
Discount (%) 


1st 


' 0 


1 


0 


0 


1 - 2na • 30th 


5 


29 


145 


145 


; 31st- 60th 


10 


30 . 


300 


: 445 


61st' 90th 


15 


30* 


450 


895 


91st - 120th 


20 


30 


600 


1.495 


121st .150th 


25 


30 


750 > 


2.245 


151st - 180th 


33 


30 *- 


900 


3J45 


181st -210th 


35 


30 


1,050 


4.195 


211th -up 


40 


n 


40n 


4,195 - 40n 



' 2. hlaintenance Costs • f 
^ Maintenance costs depend on the site category and the main- 
tenance assumptions of eacdi case* However, with the i4xception of Cate- 
gory 1,^ (CONDS sites 50 miles or less fros a service location) 
maintenance rates for the* high maintenance 6ase can be obl^ir 
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thos9 of the low maintenance case by multiplying by 4/3 for laiyJ sites 
and 6/4 for ship sites. Hence, this discussion will be concerned only 
with the low maintenance case. 

Category 1 sites would be serviced by Opscan at a cost of $80 
per month or S960 per year. Cate<gory 2 sites (CONUS sites'- between 50 
and 90 miles*^from service) would also be maj^ntaifted by Opscan but on a 
t iae-and-mater ials basis which involves-^sts of travel, i^bor ary5 
parts. Travel charges are 18 cents per sile plus $30 per hour of tra- 
vel for each failure. If an average travel speed of 45 mph is assunied, 
the average total travel cost per, year would be: 

'njaber of annual breakdowns) ($.18) (miles to the site) + {number 
of annual breaVr6owns) (1/45) ($30) (miles to the site). 

Since .this cost will vary with the distance to the site, a mean travel 
cost of $2,218 for all sites in this category was calculated. Labor 
cost is $30 per hour and the mean tirae to repair is Z 1/2 hoars; thus 
the average annual labor cost is: 

t 

f$30) (2 1/2) Inumber of annual breakdowns) - $75 (number of 
~ _ annual 

- breakdowns) 

The only information available concernir>g the cost of parts 
was Opscan *s price of $600 for a service warranty for the second year. 
This was taken as the annual parts cost. Naval personnel -would service 
all other remote (Category 3; 4, at^ 5} sites, thereto. Incurrir^ coBtk 
of ^abor and parts* The total labor cost p^t repair for service by * 



TAEG Report Noi 49 i ^ 



' Site personnel was.assun>ed to be the saae as Opscan's tot^^Hi^r 
cost. Therefore, labor cost is, as before; 

$75 (number of annual breakdowns) ♦ 



The average annual cost of replacing used parts froE, the inventory, 
based on a failure rate of- three per year, was estimated by assuming 
that Opscan's $600 per year warranty priCQ was derived on the basis of 
the price for parts used and their expected return on investBent for a 
perpetjal inventory. It'^s further assuned that they require a 30 

percent return orr their parts investment of $6,529 and that this inven- 

/ 

tory IS used by the Dpscan repairsien in servicing 10 sites* The de- 
sired return on investment is $1,960 or approximately $200 per year' per 
Site. Thus, the average? cost of parVs to the Opscan ccxspany is $400 
per year for each terminal when three annual failures occur, Tl^e saii^e 
parts cost was ass^oi&ed for service by Navy personnel, 

3. COHISAT Savings 

The savings achievable by utilizing ODKISAT to' teach the 
first 1? courses consist of three cosponentsr student travel, living 
expense at the' training center, and the cost of -terminals no longer -re- 
quired at the training center* The average cost of a one-way trip to p. 
training center is $137, In addition, a student on PCS is allowed $291 
to cover transfer of household effects. Thus, the total travel costs 
saved per student for PCS and for TDY are, respectively; 

^ S141.50 + $291 - $432.50 and ^ 

2(S141.50) =1 $283. , , 



This is a conservative assumption, persittLijg the ET to take a longer 
mean tiae to repair than the Opscan repairman since the ET's hourly 
cost is less. 
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The average travel cost, taking into account the relative frequency of 
PCS and TDY^ is; 

'1^^) ($432.50) ^ (liiiil^ ($28^) - $354.39/entrant, or 
62,909 62,909 . 

62 909 

^ ^ ) ($354.39) . 1.02{$354.39) « $361.48/graduate. 
' 61,666 

The total travel savings is: 

($361.48) (number of graduates). iSl 

The living savings is the product of the nusber of student- 
days and $2.50, the daily living allowance *t the training center. 
There is a savings of one training center tenainal for every 60 AOB 
stodents 'reached through CX3HISAT. Each training center tersin^l re- 
quires a $14 ,250 investment and a present value cost of $9,873 to saain- 
tain over eight years. Hence the savings in training center terminals 

^ ($14,250 ^ $9,873) * $402.05 AOB. 171 
60 

C* ' Calculation of Break-Even Pc^lations 

In order to determine vhioh sites should be outfitted with OKISAT 
terminals it vas necessary to calculate the population for which the - 
cost of deltveritig training to the site is equal to the savings 
achieved, because all site pc^Julations greater than this would result 
in savings. This section describes the derivation of tAe break-even 
population for each cagegory of site. 



^Tbe data in the proportions come fro« Table 

^ . .V. " . m 
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The foraula used to derive the^ breai;-e'/en popjlation is: 



? 



be - ^pv^/TGSp., 



where P. 

oe 



break-even populatiofi 



"^py = present valae of equij^nt 
H 3 enlisted personnel popjlation 

"^p.^ » present valje of travel ar^ living savings 

1 

The present valje of total gross travel af>d livir^ savir^s for 
those courses ecorosically justified for ose ^t the tra ining -centers 
w^as foj'r^ to be $23,714 , 343 when discounted at 10 percen/ over eight 
years. The total enlisted personnel p<^jlaj>€on ^2) was given as 
3"?0,346. Thus, the only qaantity needed to detersir^ the break-even 
popo.a.ion 'p^^ present value of the total cost of a sit% 

''^rr/ discounted over eight years. TC^^ is the su3 of the tersi- 
nal and spare parts costr without quantity dift<x^unts, ar>d the eight year 
present -/alue of maintenance. Two factors, total mi^ber of terminals 

CKurchased and site category, influence the value of TC vor this 

pv- 

^eason, a different break-§ven population was calculated for each cate- 
gory within each ^se. 



rr,e only exception to the calculatic^ of break-'even population by- 
site category occurs in Category 2, yhere the deper^er^ of maintenance 
cost of sileage isakes calculati<x^ of one TC^^ for the entire category 
impossible. As a result, decisicms about tY^ ir^clusion of Type 2 sites 
were ^e by cocrparing the total cost of each particular -site to the 
savings which it could contribute. 

Since quantity discounts are etvailable for terminals zmd spa^ 
paxts, the investment cc^t, arxS h^hce the total TOst, depends on the^ 
numbers of terminal and parts sets • re<Ai red. For this reasc^, the 
calculations were sede iteratively using the following steps; 

2-8 ■ 



170 



tAK Import Ko, 49 



Estimate the discount Intervals In whi<:± the ni^>er of ter- 
Binals ar^ the mr^ber of parts sets 11 fall, 

Usii>9 these estimates detersine the correct quantity Siscount 
f^tor fro2 Table 11-10. 

Use the discount factors to derive a q\jantity disooanted in- 
vestment cost of a terminal and a spare parts set. 

C^teraine TC vyy addi'^ the Investzient costs to the aain- 
tenance cost for the category under consideration 

tJse t^e eq^.jation given above to derive 

be* 



^#bose 
ea- 



Co?^re the site popjlaticH^s to ?^ to identify sites 
population is larger than P These are the sites f 
sible for COHISAT develqp^^. If the number of tersinals 
dnd spare parts are w-ithin the estimated intervals, the cor- 
rect break-even pbpjlations have been calculated. Otherwise, 
revise the interval estimates as indicated ar^ repeat the 
process . 



This procedure resulted m the identif icati<x^ of 306 feasible 
sites reqjirir^ an eacpenditure of S5, 348, 000 in present valoe over 
eight rears. | - _ 

D. Costs arKi Savir>gs in the Iterative Approach 
1 . Costs 

?or oodirses \ibos^ ^velopscnt is justified only by CXMISKT ,^ 
the cost of deveftopsent, codir>g, maintenar^ce, leasingi site terslrials, 
and the cost of ^Sditional training center terminals required by sto- 
dents who can't be reached by COiaSAT sust all be charged to CX3KISXT. 
"f^ith the exception of trainlr>g center costs, each of these is calculat- 
ed as described in Sections K and'B of this appendix. Terminal «>sts 
for ijspl»entlr>g 70 percent of the 18th and subsequent courses at the 
training c*nter are derived similar to the savings discussed In Section 
b: Bowver, the misber of students \ibo mxnt take the nev courses at 
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the trai'niag centec r^CB^) ,s ^sed :n the forrula. Thus, the train- 
ing center terminal cost charged to C^KISA? is: 

^514,250 * $9,373; 



«s«re AOB^ ^>^^ narLber of stw^ents vbo cannot be reached at their 
ovn Sites fcy the 18st ard subsequent courses. 

T-.e gross CC^ISAT cost for teaching all ^ncd'ically and 
erat;oria::y feasible courses at Havy-sites is sjr=iarized m Table II-4 
and can be found try evaloatir^ the following expressic^t 

iignt year present value Of COMISAT gross cost » - . 
^develops^nt arvd coding for courses justified only by C0*C5AT ill;* 
'ccxrpjter leasir^g 121 . * ^course eamtenance^c^courses justified 

only b*/ CDHISAT; * ?a>CISAT temmalsl ♦ <trai/Ttt:g center 

terminals 131 ). * 



Applying the appropriate formula for each cost yields: 
Eight year presept value of CCTOSAT gross cost » 



rCHISAT ter:unal cost 



6C 



4 
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where H is the total nuabe^ of eoonoeically feasible cours.es of *rhich 

70 percent can »6e converted to OtI, q . .. 

' ' <iH IS tbe nueber of graduates 
in the 70 percent of Courses 18 through N convertible to oa, and FC is 
the^percent 6f the, popolatioo which cannot be re'ached onsite through 
CCMISAT. The above ejqsressioo can be sisplified to: 

Eight year present value of OOHISAT gross costi, - 

411,426h + 11.4 q U , 

terain&l'cost 

? 

2. Savings 

The savxngs COMISAT achieve? thorough development of addition^ 
al courses consist of travel, living, ti^, and incremental living sav- 
ings. Each of these is calculated using fo'rsulas discass'ed previously 
fn rhis appendix. 

t 

The gross COHISAT savi.^s for teaching 70 'percent of the K 
hjg.hest vol.3e courses at resote sites is: ■ ' 

Eight year present value of gross COHiaT savings - (trav^ 
cost for students of all courses, as indicated in equatiSfTlei ) 

* (livi.ng costs for students of al><»ursesi * (tise costs 
for studenU of courses 18 to R, as .indicated in equation, (4|) 

♦ (Uving costs for students of courses ^8 to K as indicated 
/ in equation [51) ♦ (training center terminal costs for stu- 

substituting the proper formulas into this expression yields: 

Ei^t'year present value of gr<»s COmSAT savings » 

(5.597) (l-pc) ($J61-.48) {g} +-5.597 (1-PC) ($2.50) (51) (g) (.80) 

^^•^^^^ ^ AH (1-01) (51/365) (.20) ($10,090) + ^ ' 

9 AH<1-01H.20) (51).($2.50) (r.597) * 

training center terjp'inal costs • . - 
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where g is the total ncaber of graduates in the N courses convertible 
to CXI. . • 

This expression sia'plifies to: 

« Eight year present value of gross COHISAT savings - 2,594 g - 

2,594 g (PC) + 1,741 q ... 

y * training center terminal cost. 

Subtracting the gross savings expression free the gross oJs^ 
expression resales m net cost. A simplified' expression for net cost 
in terss of K can be obtained by ysing the identities: 

^.iN " -7 (3,110 H-*84^,iio(l7j .484, 

- 2, 177H. 484.8,578 

But, by defmitic^^N^ • , , " 

9 - 9,334 * g ' • 

i N 

- 2,l77H.4a4 + 756 - • 

« 

The simplified net- cost expression is: 

Eight year present value of net COKISAT cost - 411,426K - 
6.107, 356H. 484 * 2,342,017K.484pc * 850,425EC * 7,497,450 
+ COmSAT tersinal cost training center tereinal ojst. 

PC, COMISAT terminal cost, and training center terminal cost a^e Jcnovn 
.once the number of sites is fixed. Thus, net cost is a function of the 
single 'variab^ H. 
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The expression for net cost is u&eful in two vays. First, by 
taking its derivative, setting the result to rero, and solving for.lJ, 
the EiaxiscJB njnber of courses whic± could be justified for CHI is ob- 
tai^a. The net cost expression can also be rewritten in teras of the 
stjde-it tLir^e saving and operational constraint paraaeters. Kith the 
expression m t^;s fors the sensitivity of total cost to the paraaeters 
car easily investigated. The results of this sensitivity analysis 
were shown for the low :^intenance case in Table II-3. Siailar results 
for t^,e high sai'^.tenance case can be found in Table 



Tsb^e i 2 Stni v^tty of f^rtnnt V§iue S^nngs to TimcSr^tngs 

CMi Consent i>t hp/ Assa^pttoot Htgh MunttWKt C^se 



\ 

1 Conrtriibit lo CM^ 

I 1 




10% j 15% 


20% 


1 










S26.852 0CC 


80S 


S22 379.000 577,106.Ot)O 
• 


S32.01 2,000 
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Apperydix ? 
•* ^ DETSPMIHATIOe? 07 KAXIKUM MILEAGE 
FOR KAIKTZRAKCE BY OPSCAN PERSONKEL 

* 

In or<1er to determine the total Eiaintenance costs, a decision aust 
be ra^e re^ardiryg vhich CXJ^iUS sites' should be serviced by Opscan per- 
serine: and which by Haval /ET) personnel. The cost of service by an ET 
is constant witni- eacn of the zEalntenance cases defined m the report, 
and the cost of Ops^ban service varies only with th^ sileage to the site 
froEs the service location. Hence, all s iter beyond a determined dis- 
tance fro?5 service should have site personnel har>dle repairs; all other 
COmJS sites shDuld be serviced by OpScan. 

The break-even mileage for each case can be determined by perform- 
ing the following steps. The low maintenance case data are used as an 
illustrative example. 

i 

• Sirs the costs of parts, labor, and inventory investment to 
arrive at an eight year present value oost of ET repair. 

Cost of parts for ET repair « S400/year 

Cost of labor' for ET repair « 3(2.5)$30 « J5225/year^ 

Inventory Investment « $6,529 

Sight year present value cost of ET repair « $6,529 i 5.597 (S625) 

- $10,027 

• Sub the costs of parts, labor, and aileage to arrive at an 
- expression for tt^ eight year present value cx>8t of Opscan 

servlw as a function bl ailes to the site. 

Cost of parts for Opscan service » $600/year 
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Cost of labor for Opscan service = 3^2.5)SO0 « S225/year 

Cost of mileage for Opscan service » {$.i8)(6)d + 

a/^S) (6) (S30)d 



« si.oaa + S4d 

« S5.08d 

where d is the mileage froa the service location tq the site. 
Eight year present value cost o-f Opscan service 

« 5.597(S825 + SS.OSd} 
* $4,617 + $28. 43d 

• Sqjate these two costs. 

S10,027 . $4,617 + S28.43d ' 

• Solve the resulting equation frc^ the desired mileage. 

$10,027 - $4,617 

d = 

S28.43 

d = 190 siles 

Similar calculations for the high zaainteaance case result in 
equally high mileages. However^ response time for this distance would 
be Several hours. To reduce the terminal dovm time to more reasonable 
limits, a maxUiuis distance of 90 miles, with a two hour driving time, 
was chosen. 
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Appendix G 
WRLIKE SCHZDOLE OP TAillFFS 



The following is the current procedure used by all airlines to 
calculate the gross fare inciting tax as a function of flight distance. 

1. Insert a fixed Base Terminal charge of $16.85, 

2. Add to tfcis a series of cuiaulative charges relating to the 
flight distance involved^, as follows; 



0 - 500 niiles. 
501 - 1500 
1501 + 



$ .0877/sai. 

% .0669/si. ^ * 
$ .0643/si. 



Next include the 8% tax by aultiplying the calculated rate by 
1.08 and round up or dcvn to the nearest dollarr- 

Pros this total fare,- the airline receives t^he total fare di- 
vided by 1.08. The' U.S. Governaent receives the remaining, 
e.g*, calculate , the fare on a flight of 1,500 niles: 



^Reference Civil Aeronautics Board, Bureau of Tarl'ff 
^If a carrier flies nonstop, the point dietance.is used/ If the 
flight has intermediate stops, the mileage between the two points con- 
sists of the sua of the most direct logs available. However / if^an^ 
other airline has a direct flight at a lov^r cost, the competing 
airline will reduce his rate to , that of tW nonstop airline to coapeteJ 
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.1. 

2. 



$16.05 
S43.85 
566.90 



Totwl $126.80 
3. 



.p8). ($126.80) = $136^94 which is rounded up to $137, 



4. Prora tjxis fhe airline receives: $137/1.08 = $126.85, and 
the r^inder {$10.15 is th* tax). . ' 



7 
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* ' Appendix H 

RESEARCH DBS IQ; DATA FORMS 



TheCaggendix contains 



• The Stixfent Registration Card 

The Attitude Survey Instruction Script 

• Th^ Data Tally Sheet • 

* 

• Data Input Format: Attitudes 
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ATTITUDE SURVEY INSTRUCTIC»?S 

you are about to complete a survey designed to help the Navy get ' 
inforsiation about your feelings toward the training y^u ace currently 
receiving at this cqmahd. Before you cccaplete the survey, ve would 
like to ask you to take a few sinutes to read the information and di- 
rections on the first page of the booklet. 

Res^enber^ this is not a test; there are no right or wrong 
answers^ Your survey will be scored by per&onnel outside of this coo- 
mand and only statistical group results will be shown to anyone in your 
coessand. We are interested m your honest feelings about' the training 
progras. After reading the directions for this syrvey,' if you have any 
questions, please dc>n*t hesitate to ask before you start the survey. 
Take your tiise but try to answer each ites with, youf icsediate 'feel- 
ings. Answer each itee as honestly as yoa can. ReeepbeV^ there are no 
right or wrong answers, we just want t6 kf>ow how y^^ feel. 

y 
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Diti fnpijt format Course Per^ormtnct 

* 

where x * the, cx>va'riate entries 
^1 » BTB score 
^2 * reading ability scx>re8 
y « the deperxSent "^asure entries 

» BE/E course performance 
^2 * special electricity and electronics exas score 

k « group* identification (CHI, corre^pofKSenoer no for^I 
training) ' ' ' ^ 
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i 1. 1 ^ 1 M : 1 1 1 J. _ II M_i M I . I 1 . 1 1 M 1 1 * J . i * ' ] , I f i J I r i f i I i 



vher^ X » covariates ^pretest attitude scores for each attitude 

^ '. - . • i . " 

coerponent, ■ • . * ' . ; 

• * ■ > ♦ ' * 

r 

y*3 dependent Dea&ures {post^st attitude .^ifores for eacK 
attitiJde cospo/>ent) 



/:.. ■ 
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IKTERVIErf IKSTRCSeJ^rS 
^ t 

This apperfdix ccntains: ( , ^ 

I ' " . ' ' 

I 

I • The Seitant'Jc Dif ferenti'^1 Surrey 'Instru^ent for Students ' 

\ 

• The Sesantic Differential Survey Instri^nt >for Key\su-pport Personnel 

^ — • . _ _ . ^ > 

• The Post Interview Questions for Sti>dents ar^ Key Personnel 

( 

) 
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hpp^ridlx I, Exhibit. 1 ' 
THE SE?*AOTIC DIFFEHEKTIAL SUKVEV 

rKSTJ^oovT POP swbz^rrs 



c:R£C7IDN'S: Or tne follcvlnrg, paces w are asJtin^ you-to rate j'Cjr feelings 
tcvard^a r.^nz^: of concepts- thi-gs related tc yoar --training. In acccrdanee 
w.tr SECHAVrtiSZ 5211.5 of 14 19t5, infor^atiQn xncl^^ded :n. tne OiZ SJrvey 

:s requested jT/der the authority of £>epartseptal Hegjla- 

ticrs. r^. :s mfon^ation is required to assis": the evaluation the Oil ' 
System, yo'j axe rx^t required to provide this information, bl^ yea cac be as- \ 
sjred that ycjr in^ividjal ansve/^ will' be i:ept completely confidential arK3- no. 
ajtterpt v:!! &e eade to eva;jate yoj or t;-;e coertand yc;: are curre;?tlV wi^th 
oased or vcjr answers! ^ ^ ^ ^ * * 



Or the fcllcvirg pages yoj are as«:ed t>i«*te yojr- feelings on* th-e following' 
ccrtepts: KA—pIAl, CC^JTEP Hfa^GED IHST^.CCTIC^- , ^ LZAKHIK^ SUPET/ISOP, 

SrlTY CZKTEP, CH: TESTIHG PP1^:SI>'JRES , CX^iT^T OF CHI TESI, FEEDS ACF, 0^1 TEST 
FEEDSACT. ^H£ > / 

Here is ^x?w to jse the scales: • > 

If ycw feel *the scale relafes very closely to ^ur feelinos s^rk \t as suo^: 

stror;^ X : : : : ; : - weak 

or • ' 
Strong ' : : : : * : : X * weak 



If yoj feel the scale r'elates quite closely to your feelir>gs sark |t as such: 

strong »_• > X t : _^ : : • weak 

or 

strong *: : - : : : x : Weak 
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If you feel th^ scale related bnlx slightly to yobr feelings 'eark It as such: 
strong ^ : : X ; : • ■ s : . veak 



/ 



or 



stror^ : : , . ^ x : ' : "weak 



If you feel you are neutral or feel the scal'e is riot relevant to your fee 
sari: it as sjch: 



lings , 



stror^ : : _^ . ,x : : • . ^^-fc 

PLEASE RZHEKBEB THE POUJOWIHG^ • . ^ 

1. Hark all scales; do not skip any. 

2. Place your nark.xn the siddle of each Iine^ not in between lines. ■ 

3. Work quickly a;id do not put ©ore than one eark, for each scale* * 

- ■ 

4. Mease be *gre that you havi; filled in the necessary inforsation on the ' 
cxjver page of the survey./ • 



'4 



r 
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THE LEAi^^INd SUPEKVISOR 



informed 
bad 

ava Uable 
valuable 
effective 
inexpert 
helpful 
unqualified 
jnreliable 
uncrgani zed' 



uninfors^ed 
gocd 

unavailable* 
worthless 



ineffective 
4 



>b5tr jcp ve 



expert 
obst 
qualified 
reliable 
organised 



Cocss^^ts: Please cosssent on vhat it is that you like best about the concept 
you have rated above and what it is, you like least. 



Like best^ 



Li|ce least ; 



Other cosBeots fuse other side if nec^sary) 
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THE COTOSE'KATERIAL 



like' 
valuable 
inadequate 
seaningf ul 
. boring 
•frustrating 
' bad 
joorganized 
approv,e 
useful 



dislike 

worthless 

adequate 



meaningless 

interesting 

motivating 



goo% 
or^^ized 



^ disapprove 
useless 



Cccssents: PleaSe o:^rent on, what it i^ that you like best about the 
concept you have rated above and what it is you like^lea^t. 



Like best: 



Like least: 



CTther coisients {u«e other side if 'r>ecessarj^) : 
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THE STUDY CENTER 



Grasped 
satisfactory 
uncomfortable 
dislike 
**organi zed 
' pleasant 
noisv 



V 



disapp*rove\_ 
adequate _ 
awful 




roofny 

unsatisfactory 

comfortable 

likfe 

unorganized 

unpleasant 

quiet ' 

approve 

inadequate 

nice 



Cocanents : 



Like best: 



Please ^cossffient on wha^i^ is that you like best about the 
concegt you. have rate¥Sx)ve what It is you like least. 



r 



Like least: 



Other coeaefi^s {use -other si<Se ff necessary) : 



1-6 

m ■ 



like 
valuable 
adequate 
meaningless 
interesting 
frustrating 
gcod 
unorganized 
disapprove 
useless 



TAEG Report No, 49 



CQKPUTEK MAHAGfcD INSTRUCTICy Ott 



disIiJce 

worthless 

inadequate 

seaningful 

boring 

motivating 

bad 

organized 

appK)ve 

useful 



CoGSBents : 



Please oocasent on what it is that you like best^^ut the 
concept you have rated ^bove and what ^it is you like least. 



Like best: 



Like least; 



other coosoents" (use other side if necessary):- 
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CKi tbstiik; pi^x^bdores 



inefficient 
--disapprove 
^ I right', 
enfective 

1 " 

r 

, ai|like 
vague 
fair 
bad 
"adequate 



efficient 

approve 

vrong 

^Ineffective 
tmorg^^nized 



clear 



unfair 
good 

inadequate 



Cocaaents: Please OOTssaent on what it is that you like best about the 

cohcept you have rated above and what it is you like least*. 
« / 

* .. 

Like bestT , 



Lifce leastr 



Other cowents (use other side if necessary)* 
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CX)HTEyT OF CMI TEST FEZiaACK 



good 
dislike 
unfair 
sufficient 
.useless 
adequate 
valuable 
i r relevant 
approve 
unimportant 



bad 

like 

fair 



insufficient 

useful 
^^inadequate 

worthless 

relevant 
*<}lsapprove 

lisporjfcant 



Cocanents: Please cosment on what it is that you like )>est about the 
^ concept you have rated above and what it is you like least^ 

Like best: 



Like least: 



Other cowsents (use other side if necessary); 
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Apper>dix I, Exhibit 2 
THE SEKAKTlC DIFFERENTIAL SURVEY IHSTROKEST 
FOR KEY SUPPORT PER^'KSL 



DlRECnOKS: &n the^ follcvin^ peges we are dskir>g you to rate your fe€lir>g8 
toward a nuj^ber of concepts/ thirvgs related tq yopr trairang. In accordance 
with SECHAVtHST 5211.5 of ^4 Au^ 1975, infor^tion included m the CXI survey 
15 reqi>ested' under the aut^>arity of ^ Departsental Regula- 

tions, This information is required to assist in the evaluation of the'cKI . 
iSystes. You are not required ^o provide this infomation, but yo<3 canb^as- 
sured t>^t your individual ^nswets will be kept completely confident iffar^ no 
a^ttefrpt vUl b^ajd^ to evalt^te you or the ooer^nd ycHj'are currently with 
b^se<5 on *y5ur answers. . ' ^ ^ -^^ 

On the follovmg pages you are asked to rate your feelings on the following 
concepts: Q^cF^ KATtPIAL, COKPUTER HAgCAGED IKSTRvCIION, L^ARHI?^ SUPERVISOR. 
STODY CENTER, QO TESTIHG PROCEDOR^ , COOTECT OF OQ TEST FEZCBACK , Qfl TEST 
FEEDBACK HKE . (All but the STODEKT questions are the sau^e as the forces for 
^the stt3dent survey Instrument.' Therefore only the STUDEJrr q-uestion sheet, is 
incltided in this exhibit. > 

Here is how to' use the scalest 

1^ 



If yoir f eel 


the 


scale 


relates 


very closely tb your feelinqs sark it as 


such: 


strong X 






f . 




weak 


etrong 






* • 


or ^ i/ 

: : - : X 


• weaK 


If you feel 


the 


scale 


relates 


quite closely to your feeliWs mark it as 


feuch: 


strong 




X 






weak 


strong 


* 
* 




• 


or t 
: : ^ : 5C t 4 


weak 


If you feel 


the 


st^le 


relates 


, . . - 

only slightly to your, feelings sark it as 


such: 


strqpg 


• 
• 








weak 


strong 


• 






or 


weak 
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Appendix I, Exhibit 2 
^ TEE SEKAKTIC DIFFERENTIAL SURVEY IKSTRDHEKT 
FOR KEY SX:?K>?rr PERSCKKEL 



Dl?2CTL0}%Si On the^ foil cving pages we are asking you to rate your feelings 
toward a nusber of concepts/things related tq yofjr trairartg. In accordarice 
with SECHkVhiSl S2U.5 of ^4 Au^ 1975, infcr^tion incl^jded in the oa survey 
IS reqi^ested* under the authority of ^ Departs^ental Regula- 

tions- This information is re<juired to assist in the evaluation of the'oa , 
iSystes. You are not required ^o provide this inforsiation, but you canbs^&s- 
sored t>^t your irydividual ^nswelrs will be kept co^letely confident iafar^ do 
a^tte^^t vU.1 be^ade to evali^te you or the ooes^nd you' are currently with 
b^sed c^'y^ur answers, . * ^ . 

On the following pages you are asked to rate your feelings on the following 
concepts: CORPSE HATgpIAL, COKPCTTEP yjOikCZZ IKSTKvCTION, L^^RHI!^ SUPE^l^K, 
STUDY CEKXER, CKI TESTIHG PROCEDOR^ , COSTEKT OF CKI TEST FEETSACK , Ofl TEST 
FEEDBACK TlHE . (All but the STODEJrr questions are the se^se as the fors^ for 
^the stcdent survey InstruDent. • Therefore only the STUDENT question sheet, is 
included in this exhibit •> 

^ ' *- 

Here is tow to* use the scales: 

If ycHT feel the scale relates very closely tb your feelings Bark it as suchi 

strong X : j . ^ * . weak 

or > I' 

If you feel the scale relates quite cloeely to your feelJhgs eark it as feuch: 

strong : X : " t ; ^ ' . : »^ak 

or t ' 

stroeg : ^ s ! - : ^ : ^^ 4 weak . 

If you feel the s»le relates only slightly to your, feelijvgs sark It as sucht 

strqpg j : X t i : weak 

or 

strong t 1 s 1 X .t ' ; veak' 
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If you feel you are neutral or feel the scale is not releva nt to your feed- 
ings, sark It as sucnl • ' ^ 



trong 



J 
veak 



PLEASE REKEMBER THE POLIOWI)^; 

1. Hark ^11 scale^s; dc r>ot skip ary. 

2. Place your z-&zk in the siddle of each line., ri^t in between lines? 

3. . vfork quickly ar^i do net pjt a^re than one z^lrk for ^ach scale. 

4.. PleasFbe sjre that you have filled in the hecessiry -nforsatron on the 
ccver page cf the survey. ^ 
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TEZ STUDEKTS YOP HAVB WRKED KITB 

. dctruk^ this TmniHG pehioo 



qualified 
' stupid 
sicilled 
foolish 
unreliable 
adequate 
LTfeff ective 
dislike 

J* 

suj>erior 
gcx:x3 



unqualified 
intelligent 

_ unskilled 

_ wise • 

_ reliable 
inadequate 
effective 

_ like 
inferior 

'bad 



agents: Please extent on what It-is that you like bes^ about th% 
concept have rated ^ve -aad what it Is you like least. 

^0 



Liki 




I 



Other oowents (Use other side if necegsary) i 

; . ■ ■ / 



1-13 * 



i5§ 



TAEG Report Ho» 49 



Appendix I', SXaiBIT 3 
POST IKTEKWISW QOESTIONS FOR , * • ' 

STUDEOTS A?fD,KEY P^RSOKKEL 

CMI Concept Quest4prts . 

Gerverally, how do you feel'a6out the idea of co-puter sanagd instructior, 

' . ... 

Bow would you ccepare CKI to other forms of Naval training you have had 
in tb« past? • ■ ' ' ■ 

V 

Why did you decide to take this course? 



Have you ever taken any other .coeputer managed instruct ion "type cour$^? 

If so, ifhat was it? • ^ ' • 

f ' 

If the opportunity presented- itself , ^would you take another C3^ course? 



Study Center Quest iong > 

Generally Wbat are your feelir^ about this training center (school house)? 

Were there anyi-probleas in the study center that you fee^ are serious - 
enough to.be ©enfcioned now> ' v 
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3* Testing/Study Procedure' Questions > ^ 

Generally, what is your feeling about the testing procedure for this, 
course? 

Generally, bow do you feel about t±ie fee<£>adc ycxi received"? 

^ • 4 

Generally, how do you feel about tb* feedback tiee Interval — 

the tiee between taking a test and getting back your'test reseltf — 

during the course? ' 

f 

' ' f • 

Generally^, bov do you feel about the tice interval between study sessions 
during the course? \ 



Learning Supervisor Questions * 

Generally, bov^do you feel about the learning supervisor for this course? 

Bow do you feel about the help you received fros3 your learning supervisor 
during the course? 

J)id you feel comfortable i^en consulting with your learning supervisjjr 
during the course? ^ 



'5, The CHI Course and Course Material Questions , 

What are sose of the thingsj^you like best about the course and training 
you have received here? 

What are adme of the things you like least about the course and training 
yoo Ijave received here? « , 
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Was the trainir>g yoif received adequate? Did the course seet your needs? 
(If not, vh^?) 

How was your motivation during the oours^?- 

How -to you fe»l about jh« instructional materials that were used for the 
course (PI books, etc.^? ^ \ 

Bow^ia you find the instructional materials in tertas of your riding and 
unde-'standing? 

How do you feel about the practical 'hands on' mat/rials in the coursfe? 



Operational/Prot:edural Questions . ^ ■ 

Generally, bow do you feei about the idea ^f taking technical trailing at 
an operational site as cofspared with takir^ technical training at a 
designated technical school? 

If given the choice, which would you prefer: - 

• Training at your tour station? / , \ - ^ 

Or training at a special technical school? 

How difc you find this course in relation to your rjegular assigned work 
duties? • • . ' • 



Did you run into any problems ^rtiile taking the draining which you feel 
are serious enough to be mentioned? 
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Generally, .how do you feel about tafcing a technical course in preparation 
for your rate advancement exaa? ' 

* * * 

All in all, how did the training you received here affect you in terms of 
your job? Your career , advancement? Any other ways that you Can think of? 



general Deaographic Questions . 

How long^ have you been in the Havy? ^ ^ 

Bow long have you been at this site? 

tfow long have you been at this paygrade/rank? 

Describe what you do on your job. 

Before youf present position/job what did you do? 

-^ijfhat other kinds of technical training have you had at particular 
#lcbools — training centers? 
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Apptndix J . 
STUDZRT, KEY PERSONNEL AND MAINTERANCE LOGS 



This appendix cjontains saaples of the followirg fonasj 
♦ CMI Student Tiae Record ^ 



• 



Sumary of CorresponderK^e 
Student Progress 

t^X f^^rsonnel Tise Log 
Maintenance Log 
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Figure J- h ^tudentlTim^ Record 

Student Name ' , Social Security Numbet * ' ' .Week Ending 

.John Jones 252-22-2222 \ ' ,01/06/78 



Day 


Watch 


• 


Study 




. u/ 


• 


Test 




(mid. Pay, Eve) 


V 

Start 


End ^ 


Total 


No. 


w 

Start 


*End 


Total 


No. 


Start 


End 


Total 


Sat 

* 


(Enter x for ' 
extr^ study 
tJnr>€ off 
ouryi 






,\ . 






> 


- * 


• 


— 






Mon 


• 


* 




/ 


















Tues, 


































% 


















Wed 


























(__^ 
Thurs. 
















1 










. ir 

Fn, , 


























. — . 












11,.' 















Date. 



^ FIgun J-X Summary of Cormpondenct ^dent Progrtss 
BE/E Correspondence Courses 



Name 


oOyfai o0CuriTy nfunii/fjr 


Tot^l Study 

Ti'mA to DfitA^Pi^ 

,111110 *w 

ttiours) 


Presant 
LMfton Number 




* 


4 

S ' 


- 




f 




/ 












* 




















r 


* 


• 














* 

> 

* 
















« 




I* 









•8 
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figure J- 3. Key Penonnef Time Log 



Name * 
Ge6rge Jones 



Posrtion 
LS 



Week Ending 
01/06/78 



Day 


Substantive 
Activity 


Hours 


\ ^ 

Adminlstratrve 
Activity 


Hours 


Unusual Eyents 


Sat 


















<> 






Mon. 












Tue^ 














* 










Thurs 












Fn ' 
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Figure M, M^mtBmnce Log 



Equlpqpent 
(TypeJ.D. 
Number} 



Date/Time 
Maintenance 
Called 



Date/Time 
Maintenance 
Technician 
Arrival 



Date/Time 
Repairs 
Complete 



Note: Two looseteaf binder files w«l be kept, one for 

maintenance qf tHe communicatjons system, the other 
for maintenance of l^b equipnr>ent. Both will be 
kept attheLS'sdesk. 



Remarks 



ILSor ETtofai 
tnst^pect^ 
cause'; technician 
todeatribe 
aptual catise) • 



2? 
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Apperxiix K 

SOPPOKT RfiQUIREMENTS-nfm'ERVIEW QOESTIONS 



As discussed if)* the cl?apter on deaonstration design, key site per- 
sonnel and students vili be Interviewed to assess the support require- 
ments for operatibna^l CMIyeycjteit^ . The requirements of concern are; 

• Personnel^ ^ 

• Personnel train ir^g 

• Organization and ©anagesent structure 

• Space requiVesents and operational procedures 

• Bquipcaent, isalntenance, spare parts and logistics requirements 

These correspond to' five of the research objectives of the deaon- 
stration* Based on the issues involved in determining these req'ulre- 
Dents, Interview questions have been, developed for each of tber? 
fjollowing: 

• CoeBUnding Officer, Coraunications Officer, Division Offi- 
cers, watch supervisors, chiefs of the watch, and leading 
chiefs . ' ' 

• KO, DTC/POs, LS, aiii CKI advisor 



• ETS ^ 

s 

• Students ^ . 

- t • 

The Interviews vill be given at the end of tJat first two veeks of 
the demonstration^, at the end of fbe first apntb, and once a aonth af^ 
ter that until the end of the d^K)n8tration« 
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nn^RVIBVf QUESTIO^^S: ' Cossaand i ng Officer NAVCOKHSTA Stockton 

Coosaunications Officer 
^ Division Officers 
Watch Supervisors 
Chiefs 6f the vat ph 
Leading chiefs 

!• Are yoa sati^sfied with the progress to date of thtf COMISAT denon- 
stration? ' , ^ 

2, Do you^ffeel that you have been adequately informed regarding the 
status of the demonstration? If not, what change in reporting is 
desirable? 

3. Have you been properly informed -of problens vith the demonstration? 

'Do you feel the a<Mitional workload imposed on base perscmnel by 

* 

Vhe desjonstration is acceptable? What changes would yo-^ recoc^end? 

5. Have codipunication operations b«en affected by the existence of 
the demonstration? If so, how? What changes would you recoGser^i 
for the Ofl deHionstration to avoid a rvegative effect on operations? 

6. Are you satisfied with the aarmer^-in which ybur directiofT or si^- 
gestions regarding deaonsttati^m activities have been carried 
ou^? Are there any issues of cosaunication problems or divided 
authority that should be resolve<}? 

7. Are there my other problems you would like to discuss? Do you 
-'^ve any suggestions for dealing with thea? / 

' • " • 
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DTC/POS * ' ^ . 

Oa Advisor 

1. ^re ypu 5ati5fie<3 with tlw opportunity ycxi have to apprise the 
proper authority of problems or i^eas for iaproving the d^sonstra- 
tion? Axe yew satisfied vith the tiiae it takes for decisfons to 
be aade? 

2. Do you feel demonstration matters are given erK>i>gh attention by 
stodents and st«f/?^ 

V 

3. When there are changes in the deaonstration or in your regylar 
duties, are you given enough tise to prepare for an orderly 
transition? 

4. \re you satisfied %rith your participation in decisions concefning 
the deisonstration? c 

o 

5* Do you have enough tise to carry out your role in the deiaonstra- 
tion? If not/ what changes in staffing or procedure would you 
suggest? c * 

6. Xre you satisfied with the following as^ts of the d^onstratio^ 
facilities and operatlng^ procedures? , / 

• Learning center space and facilities, especially the use of 
the conference fooa tables for study, lab work and exass 

• The scheduling of study, lab work and ^X2£ms, including use of 
Materials 

• The scheduling of student intec^t£<3n with the LS and HTs 
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(Question 6 continued) 

• The procedures for *eepin9. student and key personnel logs and 
enteriag study timi into the cocspyter « 



7, Are there arty ^roblei^? 1^70^ have suggestions for ^esolvir^ 
thes'^' \ 
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lOTgRsaw OOESTIOf^Sf: ' Elifctranic Technicians 



1. Xre yoo satisfied with the opportunity you have to apprise the 
/ proper authority of probless or ideas for i^roviXg the 
deaoostration? Axe you satisfied with the -tise it takes for 



^e<frSions to be made? 



A 



2. Do yt>2 feel demons t rat ion satters are given enough attention 
"^your superiors and other staff? 7 

3, Wben there are charges in the desc^nstration or in youl regular 
duties, are you given 'enough tise to prepare for ^an orderly 

^ transition? 



4. Are you satisfied, with your participation in decisions cor^erning , 
the d^^nstration? * 

♦ ! 

5, Rave you been satisfactorily prepared to deal with the questions ^ 
raised by the students on technical satters? On sdiiinistrative 
matters? 



6. Wfien ycKj have to substitute for the 'learnirvg supervi^r, do you 
consider your performance of nonaal duties to be seriously af- ' 
f^ted. If Bo, what specific functions are aost affected^ a»J ' 
bow? What changes would you recoessend to correct the situation? 

« 

7. Do vou find that maintenance work in siqjport of the de»>n^tration 
reduces- your performaixje of regular duties? If so, what functions 
are aibected', and how? tfould you recoosend changes in procedures 

^ to overooae the problem? 
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8, ^ Are you satisfied with the following aspects of the desoSstration 

facilities and operating procedures? 

• Learning center space and facilities, especially the use of 
the conference roort tables for study, lab work and exams 

• The scheduling of study, lab work aod exaiss, including use of 
materials-*" ^ 

• The scheduli'^g of their interaction with the st;>dents* 

• The tasks and their scheduling for 2Ts 

• The procedures for k^ping st'jd€nt ar^ key personnel logs ar^ 
entering study tise into th^ cosiputer 

9. Are thereby problems? Do you have sixggestions for resolving 
then'' ■ i* 



« * 



'it 
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INTBRvriBW QOESTIONiS: Students 

1. Are you satisfied with the "bpportunity you have to aj^rlse the 
proper authority of problems or Ideas for Improving the ^deaonstra- 
tlon? Are decisions reached in a timely manner? 

2. Do you feel demonstration matters are given ex>ough attention by 
your superiors ar^i other staff? 

3. When there are changes in the demonstration or in your regular 
duties, are you given enough tlae to prepare for an orderly 
transition? 

V 

4. Do you consider your perforsiance of fwrEial duties to be satisfac- 
tory under the revised schedule set for the dei!u>nstratlon? If 
not, what functions ^re aost affected, and how? What changes 
would you recossaend to resolve the probiesa? 

5. Are you satisfied with the following aspects of the denonstratlon 
facilities and operating procedures? ' — ^ * 

• Learning center space and facilities, especially the use of, 
the conference rcxn tables for study t. i^ 5#©^k and^exams , 

/ "Si 

i 

• .The s<A*edullng of study, lab work ajnd exass, including use of^ 
materials . 

• ^ The scheduling of Interaction with the LS and ETs 

• The tasks and their scheduling for ETs $ * 

e The procedures for keeping student -time record's, logs, and 
entering study time into the coaputer 

6/ What other ^Jroblems exist? Do you have suggestions for resolving 
* the«? ^ 
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Appendix L 

RECORDKEEPIBG AHD PROGRESS REPORTING MXTBRIALS 



This appendix contains materials related to recordkeeping and progress 
reporting for the CMI course. The appendix contains? ^ 



/ 

• A Laboratory and Performance Progress Sheet 



• A Student Progress Sheet for LS use 



m A Study/Progress Sheet for^ student use 



r 
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i . 1 


rHDOCTRtNATfON TrttE 


"oATf 


TIME ' IWTlAl. ! 
■ i 


! BEEWLiS 




i 1 




^ ' 


1 


G#ntf»l MartJ/y Tr»*^ 


1 ^ ' 


' 1 1 






' ' : 1 


1 NuclMT Powtf 




i ' 1 



1 



tABORATORY EXPERIMENTS be compift*d twCCtwfu»y 
f>ERPORMANCE TESTS MANDATORY 



LAB START WO 



EXP STOP 



! REPEAT LAB EXP 

I 



INT j T(ME J^INT 



f»ERf I START ! RETAKE 1 | RETAKE 2 ^ WO 
TEST 



STOP Time I TIME 



INT 



3.4 



4.1 



4.3 



5.2 



5.5 




6.2 



6.3 



7.1 ^ 



10.5 



11 



13 



13 



14 



Figun L- 1. Laboratory and Performance Protest Sheet 
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NAME 



LEARNING CENTER . 



MATH 1 



MOO 1 



MOD 7-1 



MOD "7-2 



z 



MOD 2 



DC COtAP 



ex0 3-4 



MOD 8 



z 



PT 



MATH 9. 



MOD 3 



6XP 



4-1 



exp 4-3 



exp. &-€ 



MOD, 9 



MATH 10 



PT 



MOD 4 



exp. 



MOD 10 



iMAtH 5 



exp. 



5-2 



MOD 5^1 



MOD 110 



exp. 



11 



MOD 11-2 



exp. 5-5 



MATH 12" 



PT 



MOD 5-2 ly^ 



MOD 12-1 



MOO 12-2 



MATH 6 



exp, 6-2 



MOD 12-3 



exp. 



13 



exp. 



6-3 



PT 



13 



PT 



MOD 6 



MOD 13 



MOD 14-1 



exp. 



7-1 



14 



PT 



MOD 14-2 



z 



AC COf^P 



FigunL-Z LS Studfnt Proyrs Sheet 
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STODEOT STUDY/PROpKESS 
SHEET' ^ 

STUDY PROCEDttRfiS , 



This procedure sheet is furnished for your personal use. To progress through 
this course xn the proper sequence, you shoqld do each of the items on this 
sheet m the saie order in which they are listed. You may use the bl^nk space 
by each item to check off the ites or write in the work day when you have 
cxxspieted each item. If you have any questions about this 'procedure sheet# 
contact your Learning Supervisor. 



/ 



XTEM WORK DAY 



1. Take pre-math test'. , 

2. Take math Test One (if applicable). 



3.* Study Hodule One, all lessons; take Mod 1 test. 
4» Study Module Two, all lessons; take Mod 2 test. 
5. Study Module Three, all lessons; do lab experiment 3-4. 



6* Take Perfonsance Test 3. 

7. ^view' Module Three, all lessons; take.ftod 3 |est 



8. Study Module Pour, Lesson One? do lab experiment 4-1, 

\ . 
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9. Study Module Four, Wessons Two and^, Three? do lab experiment 

10. Take Performance Test 4, 

11. Review Modirle Four, lessons; take Mod 4 test; 
, 12. Take math Test Two (if applicable) • 

13. Study Module Five, Lessons One^ and Two; do lab experiment 
5-2. ^ 

lA* Review Module Five, Lessons One and Two; take Mod 5-1 test. 

15. Study Module Five, Lessons Three thru Five; do lab 
# experiment 5-5. 

16. Take i>erformance Test 5. 

17. *' Review Module Five, Lessons Three thru Five; take Mod 5-2 

test. 

18. Take ^path Test Three (if applicable). 

19. Study Module Six, Lessons One and Two; do lab experiaent 
• 6-2. 

c 

20. Study Module' Six, L^sons Three and Pour; do lab experi»fnt 
• 6-3. ' / 

21. Take Perf oraance- Test ^ 



22. Revfew Module Six, all lessons; taJce Mod 6 test. 



i'.-. 



o 
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23. Stixfy* Module Seven/ Lesson One; doJ.ab experiment 7-It4»^ 

24. Take Performance ti^st 7. . . . * 

25. Review Modu^ Seven, .Lessofi One? take Mod 7-1 test. 

<» 

26. Study Module Seven, Lessons Tvfe and Three; take Mod 7-2 test. 

y^7. Review Modules One thru Seven; take the DC comprehensive 
examination. 

« 

28. Study Module Eight, all lessons;' take Mod 8 test* 

29. Take math Test Four (if applicable). 

30. Study Module Nine, all lessons; do lab experiment 9-6. - 

2ll Review, -Module Nine, all lessons; take Mod 9 test. . ; 

> 

32. Take math Test Five (if applicable). 



\ 



33". Study Module Ten, J,es8onfi One thru Five; do lab experiment 
10-5. . 



^?4. Study Module Teh, Lesson Six; review Lessons One thru Five; 
take Hod 10 test. 

^ 35. Study Module Eleven, Lessons One thru Four; do lab 
experiij^nt 11. 

* 

3$. Review^Module Eleven, Lessons One thru Four; take Mod 11-1 
test. 
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37. Study Module Eleven, Lessons Five thru Seven? take Mod 1^ 
t^st. , * 

38. Take math Test Six (if applicable). 

♦ '-^ • 

39. Study Module Twelve, Lessons One and Two; take Mod 12-1 
test. - - . 



.*40. Study Module Twelve, Lesson Three; take Mod 12-1 test. 

41. Study Module Twelve; Lessons Four thru Six; take Mod 12-3 
test. 

42. S^udy Module Thirteen, all lessons; view sound Slide 
preservtation 13-^4 fwv-77-E) ; do lab experiaent 13. ' 

43,. Take Performance Test 13. ■ 

44. Review Module Thirteen, all lessons,Atake Hod 13 test. 

45. Study Module Fourte^, Lessons One thru Three; take Mod 
14-1 test. 

46. Study Module Fourteen, Lessons Four and Five; do lab 
experiment 14. 

47. Review Module Fourteen, Lesson^^ur and Five; take Mod 
14-2 test. 

48. Review Modules Eight thru Fourteen; Uke the AC 
coaprehensive examination. 



\ 
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. Appendix M 

ARAL^reiS COMHtmiCATIONS LIKE OWIORS 

Alternatives! Considered 

Three land line alternatives vere consideredi 

• Alternative 1: A dedicated phone line leased froe Pacific 
Telephone- connecting the Stockton cluster directly with the 
San Diego concentrator at Building 94., This option requires 
the use of a 202-T »odea at each end ^ the lini. Si^ce this 

.line would always be available, cm test sheets could^ In- 
serted at any tiae that the San Diego concentrator and 
Meaphis (XI coaputer were operating. The Keaphis cosputer 
operates fr.oa 0500 to 2030 CDT. The San Diego conS^ator 
operates frc« 0600 PDT {0800 CDT) to 1830 PDT {2030 CDT) . 

• AlternatUye- 2: A tosaercial-dial line connecting the 
S^kton, cluster to the MIISA San Diego concentrator when CMI 

. oessages are to be sent. This alternative requires a 202-S 
data set and a di^lex arrangeaent at each end of the line. 

• Alternative 3: A hybrid coeaunicationa systea whi^A uses one 
of tbAi^two 3KHZ, 4-wire phone lines currently installed be- 
tween Stockton Tech Control and HAVO0*«STA >San Diego Tech 
control when not required for Kavy operations. These lines 
are *vail^le to permit Stockt<»t to assoe sose of the Bast 
Pac full per^ terainakion requiresents. while the-^past 
tactical «sa»of these lines has been low, it is anticipated 
that future ^age wiH/be considerably increased and hence 
ttHT a«3unt o?Oti«e they would be available to the" OKI deaon- 
stration is uncertain. The back-^ip systea would be the coes- " 
■ercial dial* system (Alternatiive 2) . Because the dedi- 
cated ana d^a services require different sodeies, two systeas 
ace neede^j ■* 

— The primary systea would consist of a 202-T aodea 
connecte<? to a phone line to,be' installed froa the 
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Stockton cluster to Stockton Tech Control. ?zom there it 
would be connected .tcrt5|ie of the tactical lines to 
San Diego Tech Control. Fro© here a cocnsercial phone line 
would connect to th<^ 'Sam Diego poncentrator through another 
202-T ©ode©. 

— All of the equipisent of Alternative 2 would still be 
required as a full-ti©e backup systee. T^us, the 
'initial installation costs would be greater 'than 
Alternative 1 or 2. The only savings would bei in 
operating costs. 



In all, three cases an RP6^552 asynchronous line sodulator is needed 
to connect the line to the Oa concentrator. 



2. Cocapar 1 son 

Table M-1 shows the cost differences between the alternatives. 
The totals are as ^pllows: 



Alternative 1, Coisaercial Dedicated 



$2,602 



Alternative 2, Cocaercfial Dial 



$2; 321 plus software 
ix>dxf ications 



Alternative 3, Kavy and! Dial Back^ ^ $2,200 plus software 

sodificatiariS' 
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r«6/a k$- 1 Cost of CommunfCftfon Op^om for $jx Months 



^ Afttmetivtl: Gorm^w^l D#<ilc©t#<j i 


/ Component ^ " 


Cott 



Stockton. 

• 202-1 defeated fane mociefn 

Stoation - San Qiego 

• Defeated commer oa^ tine / 

San Diego 

• NIC 202-T 6e<j^ted fene rno6^n^ 



$ V50 ^$25 fno^ 



20O ^insta'^atK>r. 



TotSJ t2,602' 



150 f$2S TO 
122 ^^32 'r^\ " 



AK«mfftrve2. CommfrrtstI Dial 



Com{>onefrt 



Cort 



Stodaon 7 

it 

• 2G2-S datp sal, dao*ex an^ng^iefii 

Stocicton - S^ Dtego 

• Twd ooe-p» cofTvnefo^ ^^es 

• Toll charges C est J ''^ 
San E>ia^:** 

• 232'S data «t. cfep*^ ananjeirnent 



$ 278 (45 fr<^ 2a2-Si 
87 *$14 50'mo<J-jpta* 



,^ri75 1129 to fr*$i 
90 ig^^^atoni 
1,000 



270 ^$45'mo2ai-Sl 
75 (sfs^^latksdi 

132 cet mol 



f2^ 
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Art#metJv#3 Nffvy Whh W«t Backup^ 


Compontnt 








• • Co'^'>^<^ to "^ec^ Conrro^ 


$ 50) 




15© f$2S mor 


Stockion - Diego 


0 



• -^-S set. c^af^ 



175 ^123 10 fTK>l 
SO C5J«aSawni 



84 i|14 moi 

40 C^^t^^st^J 
270 ^$4S mo202-S)» 

75 ^jnsta^3tk5«l v 

87 ^$14:50/ mo dup^l 
150 ffZS^rpol 

192 <«lmo0&d^/^ 



Tola: 
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Appendix H 
SMPIZ TASKING LETTER 



SPEgPLgngR 

^ Froes: Chief of Haval Education and Training 
To: Chief of Haval Technical Training 

CcKsander, Baval TelecosBunications Cownand 

CO, KaMge^nt Instructional Inforaation Systess Activity 

Sdbj: Phase III OCHCSAT Project Requirements; tasking of 

Ref: ^a) Contract Ho, 

1. In ord^r to aeet the deaoostration requirements of the CDKISAT 
project (reference (a)), certain tiaely actions are required. To date, 
two phases have been oosq^leted. Phase I, the feasibility study, deter- 
ained that distr Ibsitlon of CXI to sMps and land bases vas possible, 
although certain constraints were identified. Phase II developed a 
practical design for use vltbin a Havy setting. Phase III Involves the 
preparation for the dejsonstratlon. Two other phases will foilo%fi 
Phase ly, the deao^stratlon, and Phase V, the evaluation. 

^ J 

.2. Th# follotflng\ requested actions are required In prep^sjatlon for . 
the demonstration. Direct liaison with action amd Information addres- 
sees Is authorised In order to deterelr^ detailed specifications. 

a. CWigCH'i^RA . j 

{ 

(1) Preside ten (10) coitplete sets of BS/B Course 69 texts, • 
Modules 1-14, and t'est sheets, lab papers, Opscan adalnistratlve fonts 
{PI, P2, P3) and terminal paper sjrfflclent to support the experiment. 
TO be onslte by 20 August 19T1 /^Coot^LnJktm with the c<^tr^tor% 

(2) Provide two (2) collets sets of all stq^port equipment 
for Course' ^/l 69, Modules 1-14, to be onslte by 20 Auguft 1977. 

(3) Provide ts^o (2) full setf^'of SEAT testing bounds on « no 
cost loan, «Ddlfled with a box covering the teft control knobrt- Also, 
provide other related oourse/lab equipment as ^eclfled by PRC.- Equip- 
ments to be onslte by^20 August 1977* 
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(4) Train and assign a Learning Center Supervisor, Assigned 
individual to be on station at RAVCOMHSTA, Stockton, California by 20 
August 1977; TAD/IVL funds to be provided by CNET. rf-BE/E training 
should start by 18 July 1977. In order to preclude personnel or cosa- 
aand inconveniences, sore than c«>e instructor may' be used as a replace- 
ment during the duration of the desKDnstration. 

(5) Coordinate with ttllSA in identifying and nonitoring 
files on control and study groups for collecting data on performance 
and attitudes. This vlll require'a search of Course 69 records for a 
historic perfonaance control group. Appropriate .functional description/ 
to be provided to MIISA by 13 July^l97'>, by the contractor .~ 

(6) B2/S TPC assist in^identifying a group of 55 trainees to 
validate the attitude test at Great Lakes Training Center, and 55 
trairf&es at Memphis. Validation to axssence 18 July 1977. Validation 
to be cocipfeted by 12 Auguafc 1977, Specif icatis^ to be provided by 
4he contractor. 

(7) Assign a staff asember to oversee the "setup of the opera- 
ting equipoent {Training and CMI) at NAVdOHMSTA, Stockton, California, 
Liait ^ s hort ters TAD^j^JVL funding to be, provided by CKET. Coordinate 
with a?BT prior to coisSitaent of furd$. ' ^ 

b. MIISA 

* 

(1) Provide NAVCC^*4STA, Stockton, California with two (2) f 
operative OPSCANAeriBinet clusters by 29t^August 1*977. Parallel acqui- 
sition paths should be concurrently pursued in order to assure selec- 
tion of the earliest single delivery source. This aay include aodifi- 
cation of the existing Honeywell/OP^CAN Contract and investigation of 
GSA Requirea^jntB Contra(^ts. 

(2) Provide standard operative CMI telecossaunication cir- 
cuits and associated equipcsents to support the CMI eguipcaent in Stock- 
ton. Operational cutover to coincide w^ith OPSCAH/Teroinet requireisents. 

1 

(3) Request MIISA DBT^ San Diego, to prepare and aail in two 
(2) day in^vals during th^' fl^t aonth of the d^onstratlon and 
weekly thereafter, student reports and other adainistrative, support re- 
ports. Also, MIISA DBT, San Diego, is to coordinate change and e^ror 
resolution with the -Stockton Learning Center Supervisor. , , 

^» (4) Requ*t KIISA'DST, Ifeaphis, to establish a Complex Iden- 
tification Hu«b€r for the Stockton trainees, estiaate tiae to cosple- 
tior\ for^a group of trainees who are representative of Stockton based 
on data ^supplied by the contractor* * 

/ ' 
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(5) All technical specificatioM ire available froe the con- 
tractor* KUSA funding requirements not presently allowed for are to 
be provided for by CHBt\ Prior coordination is required before coeait- 
»ent of funds. 

I^iaited short ter» TAD/TVL futding to be provided by . 
CFBT, for MUSA DET personnel. Coordinate prior to coeaitaent. of funds. 

C, OQKHAVTgLCOM 

(1) Cocssence preliainary preparation leading to the receipt 
of detailed specifications froo MIISA for a leased telepoqnunications 
line connecting the HAVCCMKSTA; Stockton learning coeplex with KIISA 
DET, San Die^^p. Technical data is available fro« the contractor. The 
line should be activated by 29 August 1977. All leased itea funds are 
to be provided by CKET, Prior coordination is required before coegait- 
aent of funds. ^ 

/„ 

3, In order to aaintain an open line 6f coeaunications the following 
points of contact are established for coordination purposes: 

CKBT 

ClflECHTRA 

Contractor ^ 

TAEG ^ 

DARPA 

miSX DET, Kei^his . 

MIISA DET, San Diego _ _ 

COMNAVTELOOM / ^ ' 

HAVOOKMSTA^ Stockton, CA ' 

4, Subei^. all cost? and time charged to the project in a fora suit- 
able for analy 8 specified by the contractor. The tiiae frame for 
the demonstraticAi phase of the project is froo September 1977 to March 
1978, allowing for setup and takedown ti»e. ' * 

5, Detail specifications fpr above action it^tss are available from 
the contractor . Provide telephonic verification of firm delivery 
dat«, and completion of action IteM set\forth tb the Contracting Of- 
ficer's Technical Representative (OOTR)* Rotify the COTR I'n the event 
of delivery/ooi^letion/s^edule problems. 
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Center for Nava; Analyses (2 co^s) 
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Sharroeke, J.-HarviU, Ms. P. Salop) 
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* HuaRKD (Dr. Seidel) 
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University pf .California (Dr. Herman) • ' * ^ ^ 

SofTech (Dr. Bracket*) 

California State University (Dr. Sturges) 

Texaa Chrisnan University (Dr. Danaereau) 

Conferol Data Corp. (Mr. Tor now) ^ 

Co«unicat\ons Technology Applications, Pnc. (Dr. Polcyn (10 copies)) 
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. .Internal Rsvenue Service (Mr. Kttaurin) » 
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